Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-09-24T02:03:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-24T02:03:57Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskAnoS2b/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskAnoS2b/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/security.properties
2026-09-24 02:04:06: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskAnoS2b/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskAnoS2b/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260924 02:04:17.495908 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--webserver_interface=127.2.79.254
--webserver_port=0
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260924 02:04:17.887490 2655 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:17.887820 2655 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:17.887986 2655 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:17.896765 2655 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:17.896884 2655 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:17.896942 2655 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:17.897027 2655 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:17.908169 2655 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.79.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:17.909950 2655 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:17.911916 2655 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:17.923076 2663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:17.922977 2660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:17.922999 2661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:17.924072 2655 server_base.cc:1061] running on GCE node
I20260924 02:04:17.925123 2655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:17.927196 2655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:17.928545 2655 hybrid_clock.cc:648] HybridClock initialized: now 1790215457928449 us; error 85 us; skew 500 ppm
I20260924 02:04:17.929076 2655 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:17.931922 2655 webserver.cc:533] Webserver started at http://127.2.79.254:39869/ using document root <none> and password file <none>
I20260924 02:04:17.932801 2655 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:17.932927 2655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:17.933339 2655 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:17.936453 2655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/instance:
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:17.937485 2655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal/instance:
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:17.944270 2655 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260924 02:04:17.949086 2669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:17.951285 2655 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260924 02:04:17.951556 2655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:17.951893 2655 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:17.972158 2655 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:17.973192 2655 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:17.973531 2655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:18.002416 2655 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.254:45523
I20260924 02:04:18.002521 2720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.254:45523 every 8 connection(s)
I20260924 02:04:18.004248 2655 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
I20260924 02:04:18.008438 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 2655
I20260924 02:04:18.008774 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal/instance
I20260924 02:04:18.009825 2721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:18.012454 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--webserver_interface=127.2.79.253
--webserver_port=0
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:18.019402 2721 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:18.042304 2721 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } has no permanent_uuid. Determining permanent_uuid...
W20260924 02:04:18.043820 2673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:18.045976 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:18.095424 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } attempt: 1
W20260924 02:04:18.098232 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:18.166576 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } attempt: 2
W20260924 02:04:18.169533 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:18.260901 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } attempt: 3
W20260924 02:04:18.263420 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:18.405990 2722 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:18.406348 2722 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:18.406421 2722 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260924 02:04:18.406750 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } attempt: 4
W20260924 02:04:18.409135 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:18.416396 2722 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:18.416509 2722 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:18.416592 2722 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:18.416685 2722 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:18.427721 2722 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.79.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:18.429672 2722 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:18.431936 2722 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:18.443612 2731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:18.443454 2730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:18.443511 2733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:18.445077 2722 server_base.cc:1061] running on GCE node
I20260924 02:04:18.446264 2722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:18.448294 2722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:18.449627 2722 hybrid_clock.cc:648] HybridClock initialized: now 1790215458449550 us; error 80 us; skew 500 ppm
I20260924 02:04:18.450150 2722 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:18.453459 2722 webserver.cc:533] Webserver started at http://127.2.79.253:39211/ using document root <none> and password file <none>
I20260924 02:04:18.454577 2722 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:18.454771 2722 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:18.455443 2722 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:18.458587 2722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/instance:
uuid: "23f4e9ecc0904d0ba15506c5c2206881"
format_stamp: "Formatted at 2026-09-24 02:04:18 on dist-test-slave-q97n"
I20260924 02:04:18.459928 2722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal/instance:
uuid: "23f4e9ecc0904d0ba15506c5c2206881"
format_stamp: "Formatted at 2026-09-24 02:04:18 on dist-test-slave-q97n"
I20260924 02:04:18.469348 2722 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.007s sys 0.001s
I20260924 02:04:18.474485 2739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:18.476773 2722 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260924 02:04:18.477037 2722 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
uuid: "23f4e9ecc0904d0ba15506c5c2206881"
format_stamp: "Formatted at 2026-09-24 02:04:18 on dist-test-slave-q97n"
I20260924 02:04:18.477348 2722 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:18.523088 2722 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:18.524153 2722 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:18.524513 2722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:18.550837 2722 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.253:40759
I20260924 02:04:18.550875 2790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.253:40759 every 8 connection(s)
I20260924 02:04:18.553139 2722 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
I20260924 02:04:18.557951 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 2722
I20260924 02:04:18.558207 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal/instance
I20260924 02:04:18.559161 2791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:18.559731 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--webserver_interface=127.2.79.252
--webserver_port=0
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:18.568807 2791 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:18.585547 2791 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:18.594898 2791 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
W20260924 02:04:18.596326 2742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:18.598150 2791 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.647563 2791 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 1
W20260924 02:04:18.649950 2791 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.708462 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } attempt: 5
I20260924 02:04:18.715663 2721 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:18.718235 2791 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 2
W20260924 02:04:18.719215 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:18.720582 2791 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.770532 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 1
W20260924 02:04:18.773387 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.811915 2791 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 3
W20260924 02:04:18.814618 2791 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.841709 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 2
W20260924 02:04:18.844362 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.950688 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 3
W20260924 02:04:18.953756 2721 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:18.957950 2791 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 4
W20260924 02:04:18.960712 2791 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:18.972674 2792 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:18.973114 2792 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:18.973279 2792 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:18.983160 2792 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:18.983301 2792 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:18.983407 2792 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:18.983487 2792 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:18.995767 2792 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.79.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:18.997714 2792 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:19.000001 2792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:19.013623 2801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:19.013197 2802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:19.018317 2792 server_base.cc:1061] running on GCE node
W20260924 02:04:19.018769 2804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:19.020166 2792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:19.022289 2792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:19.023811 2792 hybrid_clock.cc:648] HybridClock initialized: now 1790215459023725 us; error 77 us; skew 500 ppm
I20260924 02:04:19.024504 2792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:19.027717 2792 webserver.cc:533] Webserver started at http://127.2.79.252:42477/ using document root <none> and password file <none>
I20260924 02:04:19.028590 2792 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:19.028702 2792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:19.029083 2792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:19.032020 2792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/instance:
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:19.032898 2792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal/instance:
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:19.040705 2792 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260924 02:04:19.046478 2810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:19.048851 2792 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260924 02:04:19.049119 2792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:19.049407 2792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:19.081923 2792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:19.083062 2792 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:19.083382 2792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:19.109225 2792 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.252:44061
I20260924 02:04:19.109246 2861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.252:44061 every 8 connection(s)
I20260924 02:04:19.111135 2792 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
I20260924 02:04:19.115501 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 2792
I20260924 02:04:19.115708 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal/instance
I20260924 02:04:19.116410 2862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:19.125389 2862 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:19.131057 2721 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 4
I20260924 02:04:19.144582 2862 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:19.152227 2721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap starting.
I20260924 02:04:19.156335 2862 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
I20260924 02:04:19.157759 2721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:19.160290 2721 log.cc:826] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:19.164469 2721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: No bootstrap required, opened a new log
I20260924 02:04:19.169576 2862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap starting.
I20260924 02:04:19.171386 2721 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.172027 2721 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:19.172164 2721 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b31e7e4c8ff4e30980f19a91551e618, State: Initialized, Role: FOLLOWER
I20260924 02:04:19.172923 2721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.174228 2862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:19.174130 2871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.174934 2871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.176131 2721 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:19.176671 2862 log.cc:826] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:19.180948 2862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: No bootstrap required, opened a new log
I20260924 02:04:19.196532 2862 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.196941 2862 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:19.197084 2862 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Initialized, Role: FOLLOWER
I20260924 02:04:19.197849 2862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.198824 2889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.199218 2889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.193382 2655 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: OK, instance_id { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" instance_seqno: 1790215458542411 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 02:04:19.200235 2655 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260924 02:04:19.200366 2886 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 02:04:19.200515 2886 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 02:04:19.204947 2862 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: configured and running, proceeding with master startup.
W20260924 02:04:19.227254 2675 tablet.cc:2433] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 02:04:19.259995 2791 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } attempt: 5
I20260924 02:04:19.281466 2791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap starting.
I20260924 02:04:19.257057 2792 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: OK, instance_id { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" instance_seqno: 1790215458542411 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 02:04:19.301050 2792 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:19.303709 2791 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:19.305286 2791 log.cc:826] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:19.314690 2791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: No bootstrap required, opened a new log
W20260924 02:04:19.322431 2904 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 02:04:19.322993 2904 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 02:04:19.324623 2791 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.325050 2791 raft_consensus.cc:385] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:19.325198 2791 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Initialized, Role: FOLLOWER
I20260924 02:04:19.326084 2791 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.327294 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.327742 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.328934 2791 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: configured and running, proceeding with master startup.
W20260924 02:04:19.335952 2816 tablet.cc:2433] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 02:04:19.337971 2907 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:19.338304 2907 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.340865 2907 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:19.342077 2837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:19.343104 2837 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 0.
I20260924 02:04:19.346022 2696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:19.346704 2696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 0.
I20260924 02:04:19.347652 2743 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters:
I20260924 02:04:19.348259 2907 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:19.348446 2907 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:19.348573 2907 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:19.352948 2907 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.354508 2696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618"
I20260924 02:04:19.354620 2907 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 1 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:19.354791 2696 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:19.355896 2837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593"
I20260924 02:04:19.356164 2837 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:19.359570 2696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 1.
I20260924 02:04:19.370270 2837 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 1.
I20260924 02:04:19.371212 2742 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593; no voters:
I20260924 02:04:19.371755 2907 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:19.402122 2907 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 LEADER]: Becoming Leader. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Running, Role: LEADER
I20260924 02:04:19.403002 2907 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:19.411082 2924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.411444 2924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
W20260924 02:04:19.422466 2922 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 02:04:19.422731 2922 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 02:04:19.422912 2926 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:19.425154 2926 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:19.447154 2837 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Refusing update from remote peer 23f4e9ecc0904d0ba15506c5c2206881: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:19.448735 2924 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:19.463233 2696 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Refusing update from remote peer 23f4e9ecc0904d0ba15506c5c2206881: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:19.464413 2924 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:19.503536 2871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.503873 2871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.511049 2927 mvcc.cc:204] Tried to move back new op lower bound from 7332722521881047040 to 7332722521721114624. Current Snapshot: MvccSnapshot[applied={T|T < 7332722521881047040}]
I20260924 02:04:19.515349 2929 mvcc.cc:204] Tried to move back new op lower bound from 7332722521881047040 to 7332722521721114624. Current Snapshot: MvccSnapshot[applied={T|T < 7332722521881047040}]
I20260924 02:04:19.517506 2889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.517846 2889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.523097 2926 catalog_manager.cc:1396] Generated new cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:19.523247 2926 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:19.523900 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.524211 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:19.524473 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.524659 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:19.552610 2928 mvcc.cc:204] Tried to move back new op lower bound from 7332722521881047040 to 7332722521721114624. Current Snapshot: MvccSnapshot[applied={T|T < 7332722521881047040}]
I20260924 02:04:19.559000 2871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.559315 2871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.562288 2889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:19.562621 2889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:19.593984 2926 catalog_manager.cc:1419] Generated new certificate authority record
I20260924 02:04:19.596050 2926 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:19.649850 2926 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Generated new TSK 0
I20260924 02:04:19.652031 2926 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:19.654217 2926 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:19.660060 2926 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260924 02:04:19.679127 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.79.193:0
--local_ip_for_outbound_sockets=127.2.79.193
--webserver_interface=127.2.79.193
--webserver_port=0
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260924 02:04:20.202749 2886 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:20.202872 2886 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: loading cluster ID for follower catalog manager: success
I20260924 02:04:20.205752 2886 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: acquiring CA information for follower catalog manager: success
I20260924 02:04:20.208568 2886 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 02:04:20.272449 2936 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:20.272838 2936 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:20.272934 2936 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:20.284377 2936 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:20.284610 2936 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.79.193
I20260924 02:04:20.296080 2936 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.79.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.79.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.79.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:20.297799 2936 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:20.299743 2936 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:20.310702 2941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:20.313707 2942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:20.314122 2944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:20.314888 2936 server_base.cc:1061] running on GCE node
I20260924 02:04:20.315855 2936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:20.317160 2936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:20.318467 2936 hybrid_clock.cc:648] HybridClock initialized: now 1790215460318411 us; error 101 us; skew 500 ppm
I20260924 02:04:20.319023 2936 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:20.321822 2936 webserver.cc:533] Webserver started at http://127.2.79.193:41851/ using document root <none> and password file <none>
I20260924 02:04:20.322805 2936 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:20.323067 2936 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:20.323534 2936 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:20.325158 2904 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:20.325245 2904 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: loading cluster ID for follower catalog manager: success
I20260924 02:04:20.326670 2936 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data/instance:
uuid: "d9543f73523d42ad9995f4ac079044b5"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.327713 2936 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/instance:
uuid: "d9543f73523d42ad9995f4ac079044b5"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.328406 2904 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: acquiring CA information for follower catalog manager: success
I20260924 02:04:20.330610 2904 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:20.335637 2936 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260924 02:04:20.340662 2950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:20.342850 2936 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260924 02:04:20.343159 2936 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal
uuid: "d9543f73523d42ad9995f4ac079044b5"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.343465 2936 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:20.369201 2936 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:20.370733 2936 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:20.371119 2936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:20.372596 2936 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 02:04:20.375108 2936 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 02:04:20.375254 2936 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:20.375375 2936 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 02:04:20.375459 2936 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:20.436764 2936 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.193:43159
I20260924 02:04:20.436935 3062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.193:43159 every 8 connection(s)
I20260924 02:04:20.438777 2936 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/data/info.pb
I20260924 02:04:20.447633 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 2936
I20260924 02:04:20.447899 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/instance
I20260924 02:04:20.456930 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.79.194:0
--local_ip_for_outbound_sockets=127.2.79.194
--webserver_interface=127.2.79.194
--webserver_port=0
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260924 02:04:20.468035 3063 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:20.468724 3063 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:20.470331 3063 heartbeater.cc:507] Master 127.2.79.252:44061 requested a full tablet report, sending...
I20260924 02:04:20.473145 3064 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:20.473338 3064 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:20.473500 2827 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:20.474013 3064 heartbeater.cc:507] Master 127.2.79.254:45523 requested a full tablet report, sending...
I20260924 02:04:20.476344 2686 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:20.479223 3065 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:20.479429 3065 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:20.480005 3065 heartbeater.cc:507] Master 127.2.79.253:40759 requested a full tablet report, sending...
I20260924 02:04:20.482033 2755 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:20.484172 2755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.79.193:39881
I20260924 02:04:20.563908 3074 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:20.564767 3074 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:20.566666 3074 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:20.567592 2695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:20.567775 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:20.568881 2814 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:20.569427 3074 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260924 02:04:20.894533 3073 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:20.894897 3073 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:20.895081 3073 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260924 02:04:20.900947 3078 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:20.901191 3078 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:20.902751 3078 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:20.903344 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:20.903491 2836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:20.904206 2672 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:20.904644 3078 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260924 02:04:20.906144 3073 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:20.906359 3073 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.79.194
I20260924 02:04:20.917929 3073 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.79.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.79.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.79.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:20.919866 3073 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:20.921963 3073 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:20.934458 3080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:20.934886 3083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:20.934479 3081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:20.936933 3073 server_base.cc:1061] running on GCE node
I20260924 02:04:20.937844 3073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:20.939805 3073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:20.941061 3073 hybrid_clock.cc:648] HybridClock initialized: now 1790215460941012 us; error 48 us; skew 500 ppm
I20260924 02:04:20.941584 3073 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:20.944658 3073 webserver.cc:533] Webserver started at http://127.2.79.194:33681/ using document root <none> and password file <none>
I20260924 02:04:20.945605 3073 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:20.945715 3073 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:20.946169 3073 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:20.949542 3073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data/instance:
uuid: "c3d5f64871b3487b9705befe2938e289"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.950557 3073 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/instance:
uuid: "c3d5f64871b3487b9705befe2938e289"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.957757 3073 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260924 02:04:20.962477 3089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:20.964673 3073 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 02:04:20.964917 3073 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal
uuid: "c3d5f64871b3487b9705befe2938e289"
format_stamp: "Formatted at 2026-09-24 02:04:20 on dist-test-slave-q97n"
I20260924 02:04:20.965188 3073 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:20.987388 3065 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:21.006868 3073 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:21.008056 3073 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:21.008358 3073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:21.009677 3073 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 02:04:21.012192 3073 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 02:04:21.012336 3073 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:21.012450 3073 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 02:04:21.012516 3073 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:21.067728 3073 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.194:39273
I20260924 02:04:21.067729 3201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.194:39273 every 8 connection(s)
I20260924 02:04:21.070907 3073 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/data/info.pb
I20260924 02:04:21.079355 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 3073
I20260924 02:04:21.079599 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/instance
I20260924 02:04:21.085884 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.79.195:0
--local_ip_for_outbound_sockets=127.2.79.195
--webserver_interface=127.2.79.195
--webserver_port=0
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260924 02:04:21.109719 3202 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:21.109748 3204 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:21.110095 3202 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.110102 3204 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.111931 3204 heartbeater.cc:507] Master 127.2.79.253:40759 requested a full tablet report, sending...
I20260924 02:04:21.112673 3203 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:21.112829 3203 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.113157 3202 heartbeater.cc:507] Master 127.2.79.252:44061 requested a full tablet report, sending...
I20260924 02:04:21.113660 3203 heartbeater.cc:507] Master 127.2.79.254:45523 requested a full tablet report, sending...
I20260924 02:04:21.115039 2827 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:21.116405 2755 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:21.117830 2755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.79.194:49687
I20260924 02:04:21.119642 2686 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:21.409276 3213 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:21.409456 3213 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:21.410279 3213 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:21.410910 2836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:21.411258 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:21.411798 2673 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:21.412101 3213 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260924 02:04:21.551752 3212 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:21.552165 3212 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:21.552332 3212 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:21.562457 3212 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:21.562723 3212 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.79.195
I20260924 02:04:21.574534 3212 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.79.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.79.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.79.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:21.576982 3212 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:21.579597 3212 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:21.592494 3218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:21.594630 3219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:21.594995 3222 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:21.595317 3222 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
W20260924 02:04:21.595682 3221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:21.596410 3222 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:21.597123 2695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:21.597308 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:21.597841 3212 server_base.cc:1061] running on GCE node
I20260924 02:04:21.598101 2814 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:21.598417 3222 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 02:04:21.598861 3212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:21.600139 3212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:21.601509 3212 hybrid_clock.cc:648] HybridClock initialized: now 1790215461601460 us; error 41 us; skew 500 ppm
I20260924 02:04:21.601959 3212 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:21.604861 3212 webserver.cc:533] Webserver started at http://127.2.79.195:41701/ using document root <none> and password file <none>
I20260924 02:04:21.606492 3212 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:21.606700 3212 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:21.607245 3212 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 02:04:21.610862 3212 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data/instance:
uuid: "79827750d7ae4673803de4e9415165e6"
format_stamp: "Formatted at 2026-09-24 02:04:21 on dist-test-slave-q97n"
I20260924 02:04:21.611913 3212 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/instance:
uuid: "79827750d7ae4673803de4e9415165e6"
format_stamp: "Formatted at 2026-09-24 02:04:21 on dist-test-slave-q97n"
I20260924 02:04:21.618798 3212 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260924 02:04:21.623143 3228 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:21.623360 3204 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:21.625090 3212 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 02:04:21.625336 3212 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal
uuid: "79827750d7ae4673803de4e9415165e6"
format_stamp: "Formatted at 2026-09-24 02:04:21 on dist-test-slave-q97n"
I20260924 02:04:21.625591 3212 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:21.642661 3212 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:21.643867 3212 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:21.644217 3212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:21.645298 3212 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260924 02:04:21.647241 3212 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 02:04:21.647378 3212 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:21.647518 3212 ts_tablet_manager.cc:616] Registered 0 tablets
I20260924 02:04:21.647606 3212 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:21.690393 3212 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.195:43417
I20260924 02:04:21.690433 3340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.195:43417 every 8 connection(s)
I20260924 02:04:21.692163 3212 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/data/info.pb
I20260924 02:04:21.701538 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 3212
I20260924 02:04:21.701784 2367 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/instance
I20260924 02:04:21.720332 3343 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:21.720749 3343 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.721311 3342 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:21.721484 3342 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.722039 3343 heartbeater.cc:507] Master 127.2.79.253:40759 requested a full tablet report, sending...
I20260924 02:04:21.722105 3342 heartbeater.cc:507] Master 127.2.79.254:45523 requested a full tablet report, sending...
I20260924 02:04:21.723067 3341 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:21.723215 3341 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:21.724103 2686 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:21.724213 3341 heartbeater.cc:507] Master 127.2.79.252:44061 requested a full tablet report, sending...
I20260924 02:04:21.724579 2755 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:21.725663 2755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.79.195:39331
I20260924 02:04:21.726493 2827 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:21.734890 2367 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260924 02:04:21.787197 2756 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_528cbec5084a4988ba0fd4a1f3b9ad2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.793237 2747 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_2aca678f0ea244b0be45a1b4c61b5a25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.789820 2752 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_f9adc6e782ff4b0da3c645863cec8907"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.787935 2754 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_9d13d6a0997c452789c83619b5e41dfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.785297 2755 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_70811bdb724048a99d02b5f3d7a6f6db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.789743 2753 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_db2d035430a54e0fb0680906d7f36ccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.791826 2748 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_f021dac94f15432cac9fc0e59d54b0be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.791242 2749 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_784a6bfac1a7463294326833a9ec4c8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.790086 2751 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:21.790491 2750 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_713dab067b0f4190bad1daff3eb7bff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 02:04:21.806041 2756 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_528cbec5084a4988ba0fd4a1f3b9ad2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 02:04:21.834918 2367 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu pid 2655
I20260924 02:04:21.837097 2716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 02:04:22.002671 2367 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu with pid 2655
W20260924 02:04:22.035857 3064 heartbeater.cc:646] Failed to heartbeat to 127.2.79.254:45523 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.2.79.254:45523 (error 108)
W20260924 02:04:22.039785 2743 consensus_peers.cc:597] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 -> Peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Couldn't send request to peer 9b31e7e4c8ff4e30980f19a91551e618. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260924 02:04:22.145038 3203 heartbeater.cc:646] Failed to heartbeat to 127.2.79.254:45523 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:22.211386 3395 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:22.215844 3395 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
W20260924 02:04:22.220808 2814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:22.221278 3395 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:22.228546 3343 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:22.236933 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
W20260924 02:04:22.240000 2814 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:22.240324 2814 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:22.240906 3395 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260924 02:04:22.244292 3342 heartbeater.cc:646] Failed to heartbeat to 127.2.79.254:45523 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:22.423111 2756 catalog_manager.cc:2213] created HMS catalog entry for table [id=d26b20efde04498ab7e76f79cd6840ab]
W20260924 02:04:22.426560 2752 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f9adc6e782ff4b0da3c645863cec8907 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.427330 2754 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9d13d6a0997c452789c83619b5e41dfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.428539 2747 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2aca678f0ea244b0be45a1b4c61b5a25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.429587 2755 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_70811bdb724048a99d02b5f3d7a6f6db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.430603 2753 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_db2d035430a54e0fb0680906d7f36ccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.431718 2748 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f021dac94f15432cac9fc0e59d54b0be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.432741 2749 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_784a6bfac1a7463294326833a9ec4c8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.433779 2751 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:22.434788 2750 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_713dab067b0f4190bad1daff3eb7bff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 02:04:22.503338 3403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:22.503684 3403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:22.508788 2756 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_528cbec5084a4988ba0fd4a1f3b9ad2a" } new_table_name: "default.Table_ca026bc3ca2044659a0f0d9a2a3fa7c0" modify_external_catalogs: true
I20260924 02:04:22.519480 2754 catalog_manager.cc:2213] created HMS catalog entry for table [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:22.540463 2754 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_9d13d6a0997c452789c83619b5e41dfe" } new_table_name: "default.Table_685250380f8543c9bbaeca23f7d90fef" modify_external_catalogs: true
I20260924 02:04:22.593542 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.594687 3276 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.595995 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e16445f04a44a41fcb8584cedb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.595623 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.597282 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911de16d0fa4f639f9121bfe5c75575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.601564 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911de16d0fa4f639f9121bfe5c75575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.603127 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.603987 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e16445f04a44a41fcb8584cedb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.611533 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.612767 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2911de16d0fa4f639f9121bfe5c75575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.610896 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.617475 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0e16445f04a44a41fcb8584cedb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.618575 2747 catalog_manager.cc:2213] created HMS catalog entry for table [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:22.627988 3417 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:22.629169 2747 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_2aca678f0ea244b0be45a1b4c61b5a25" } new_table_name: "default.Table_2bbb2478ff414d04806f78dccbcabc8c" modify_external_catalogs: true
I20260924 02:04:22.637652 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--webserver_interface=127.2.79.254
--webserver_port=39869
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:22.639441 3417 tablet_bootstrap.cc:654] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.639524 3274 tablet_service.cc:1511] Processing CreateTablet for tablet c50b70fd127744b2942ff5d92f32295c (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.640089 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50b70fd127744b2942ff5d92f32295c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.641022 3417 log.cc:826] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:22.644716 2997 tablet_service.cc:1511] Processing CreateTablet for tablet c50b70fd127744b2942ff5d92f32295c (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.645411 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50b70fd127744b2942ff5d92f32295c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.654592 3135 tablet_service.cc:1511] Processing CreateTablet for tablet c50b70fd127744b2942ff5d92f32295c (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.655227 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50b70fd127744b2942ff5d92f32295c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.667368 3422 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:22.673081 3422 tablet_bootstrap.cc:654] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.674716 3422 log.cc:826] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:22.679350 3417 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:22.680061 3422 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:22.680590 3422 ts_tablet_manager.cc:1403] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260924 02:04:22.699796 3421 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:22.701682 3422 raft_consensus.cc:359] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.702183 3422 raft_consensus.cc:385] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.702327 3422 raft_consensus.cc:740] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.703313 3417 ts_tablet_manager.cc:1403] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.000s
I20260924 02:04:22.703878 3421 tablet_bootstrap.cc:654] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.705328 3421 log.cc:826] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:22.710469 3417 raft_consensus.cc:359] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.712440 3422 consensus_queue.cc:260] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.715706 3421 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:22.716178 3421 ts_tablet_manager.cc:1403] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.004s
I20260924 02:04:22.710923 3417 raft_consensus.cc:385] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.723173 3417 raft_consensus.cc:740] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.724102 3417 consensus_queue.cc:260] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.725003 3422 ts_tablet_manager.cc:1434] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.044s user 0.005s sys 0.006s
I20260924 02:04:22.725533 3422 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:22.727597 3422 tablet_bootstrap.cc:654] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.728044 3421 raft_consensus.cc:359] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.729689 3421 raft_consensus.cc:385] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.729909 3421 raft_consensus.cc:740] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.731067 3421 consensus_queue.cc:260] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.739079 3417 ts_tablet_manager.cc:1434] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.036s user 0.008s sys 0.006s
I20260924 02:04:22.741905 3417 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:22.744037 3417 tablet_bootstrap.cc:654] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.753134 3422 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:22.753484 3422 ts_tablet_manager.cc:1403] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260924 02:04:22.755049 3422 raft_consensus.cc:359] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.755342 3422 raft_consensus.cc:385] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.755473 3422 raft_consensus.cc:740] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.755833 3422 consensus_queue.cc:260] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.756843 3421 ts_tablet_manager.cc:1434] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.040s user 0.022s sys 0.006s
I20260924 02:04:22.759580 3421 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:22.760993 3417 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:22.761324 3417 ts_tablet_manager.cc:1403] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260924 02:04:22.762495 3421 tablet_bootstrap.cc:654] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.762794 3417 raft_consensus.cc:359] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.763181 3417 raft_consensus.cc:385] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.763356 3417 raft_consensus.cc:740] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.763465 3422 ts_tablet_manager.cc:1434] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260924 02:04:22.763816 3422 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:22.765847 3422 tablet_bootstrap.cc:654] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.763863 3417 consensus_queue.cc:260] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.769966 3417 ts_tablet_manager.cc:1434] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260924 02:04:22.770419 3417 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:22.771158 3422 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:22.771282 3425 raft_consensus.cc:493] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:22.771433 3422 ts_tablet_manager.cc:1403] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260924 02:04:22.771552 3425 raft_consensus.cc:515] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.772373 3422 raft_consensus.cc:359] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.772578 3422 raft_consensus.cc:385] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.772620 3417 tablet_bootstrap.cc:654] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.772671 3422 raft_consensus.cc:740] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.772943 3422 consensus_queue.cc:260] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.774121 3425 leader_election.cc:290] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:22.786056 3417 tablet_bootstrap.cc:492] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:22.786863 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911de16d0fa4f639f9121bfe5c75575" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:22.787433 3018 raft_consensus.cc:2468] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:22.788470 3090 leader_election.cc:304] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:22.789155 3425 raft_consensus.cc:2804] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:22.789378 3425 raft_consensus.cc:493] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:22.789529 3425 raft_consensus.cc:3060] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:22.792873 3425 raft_consensus.cc:515] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.793246 3417 ts_tablet_manager.cc:1403] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260924 02:04:22.794209 3417 raft_consensus.cc:359] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.795554 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911de16d0fa4f639f9121bfe5c75575" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:22.795768 3018 raft_consensus.cc:3060] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:22.799156 3018 raft_consensus.cc:2468] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:22.799827 3090 leader_election.cc:304] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:22.800243 3417 raft_consensus.cc:385] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.800392 3417 raft_consensus.cc:740] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.800870 3425 leader_election.cc:290] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:22.801152 3417 consensus_queue.cc:260] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.801550 3425 raft_consensus.cc:2804] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:22.802065 3417 ts_tablet_manager.cc:1434] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260924 02:04:22.802294 3425 raft_consensus.cc:697] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:22.802881 3425 consensus_queue.cc:237] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.807508 3295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911de16d0fa4f639f9121bfe5c75575" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:22.807535 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2911de16d0fa4f639f9121bfe5c75575" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:22.809046 3422 ts_tablet_manager.cc:1434] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.038s user 0.001s sys 0.004s
W20260924 02:04:22.810896 3092 leader_election.cc:343] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:22.812880 3421 tablet_bootstrap.cc:492] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:22.813165 3421 ts_tablet_manager.cc:1403] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.002s
I20260924 02:04:22.814474 3421 raft_consensus.cc:359] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.814786 3421 raft_consensus.cc:385] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.814934 3421 raft_consensus.cc:740] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.815361 3421 consensus_queue.cc:260] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.820487 3421 ts_tablet_manager.cc:1434] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260924 02:04:22.824501 3421 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:22.826489 3421 tablet_bootstrap.cc:654] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.829702 2755 catalog_manager.cc:2213] created HMS catalog entry for table [id=7326711a164e44aea0a2686a91820cc4]
W20260924 02:04:22.834910 3205 tablet.cc:2433] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 02:04:22.837740 3421 tablet_bootstrap.cc:492] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:22.837967 3421 ts_tablet_manager.cc:1403] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.001s
I20260924 02:04:22.838274 2755 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 1) took 1054 ms. Trace:
I20260924 02:04:22.838886 3421 raft_consensus.cc:359] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.839143 3421 raft_consensus.cc:385] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.839241 3421 raft_consensus.cc:740] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.839620 3421 consensus_queue.cc:260] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:22.838459 2755 rpcz_store.cc:276] 0924 02:04:21.784254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.784378 (+ 124us) service_pool.cc:224] Handling call
0924 02:04:22.429683 (+645305us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.430151 (+ 468us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:22.829628 (+399477us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:22.837969 (+ 8341us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:22.838091 (+ 122us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:22.838226 (+ 135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:22.830771 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:22.830910 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:22.830917 (+ 7us) write_op.cc:435] Acquired schema lock
0924 02:04:22.830920 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:22.831060 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:22.831077 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:22.831082 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:22.831175 (+ 93us) tablet.cc:701] Row locks acquired
0924 02:04:22.831178 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:22.831234 (+ 56us) write_op.cc:270] Start()
0924 02:04:22.831281 (+ 47us) write_op.cc:276] Timestamp: P: 1790215462831195 usec, L: 0
0924 02:04:22.831286 (+ 5us) op_driver.cc:348] REPLICATION: starting
0924 02:04:22.831540 (+ 254us) log.cc:844] Serialized 432 byte log entry
0924 02:04:22.837018 (+ 5478us) op_driver.cc:464] REPLICATION: finished
0924 02:04:22.837276 (+ 258us) write_op.cc:301] APPLY: starting
0924 02:04:22.837301 (+ 25us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:22.837353 (+ 52us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:22.837392 (+ 39us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:22.837504 (+ 112us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:22.837539 (+ 35us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:22.837546 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:22.837645 (+ 99us) log.cc:844] Serialized 28 byte log entry
0924 02:04:22.837725 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:22.837751 (+ 26us) write_op.cc:454] Released schema lock
0924 02:04:22.837758 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:22.837836 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:22.837839 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":188187,"Hive Metastore.run_cpu_time_us":303,"Hive Metastore.run_wall_time_us":210852,"child_traces":[["op",{"apply.queue_time_us":188,"apply.run_cpu_time_us":558,"apply.run_wall_time_us":557,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":936,"prepare.run_wall_time_us":937,"raft.queue_time_us":1374,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"replication_time_us":5685}]]}
I20260924 02:04:22.844379 3421 ts_tablet_manager.cc:1434] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260924 02:04:22.855890 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 005e9901c235496cacef80d431b60cc2 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.856508 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005e9901c235496cacef80d431b60cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.861656 2755 catalog_manager.cc:5838] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:22.864562 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 005e9901c235496cacef80d431b60cc2 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.865056 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005e9901c235496cacef80d431b60cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.879659 3135 tablet_service.cc:1511] Processing CreateTablet for tablet 005e9901c235496cacef80d431b60cc2 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.880173 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 005e9901c235496cacef80d431b60cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.895066 2753 catalog_manager.cc:2213] created HMS catalog entry for table [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:22.902688 2753 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 4) took 1113 ms. Trace:
I20260924 02:04:22.902861 2753 rpcz_store.cc:276] 0924 02:04:21.788849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.789046 (+ 197us) service_pool.cc:224] Handling call
0924 02:04:22.430733 (+641687us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.431233 (+ 500us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:22.894985 (+463752us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:22.902414 (+ 7429us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:22.902539 (+ 125us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:22.902645 (+ 106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:22.896027 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:22.896156 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:22.896162 (+ 6us) write_op.cc:435] Acquired schema lock
0924 02:04:22.896164 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:22.896274 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:22.896289 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:22.896294 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:22.896372 (+ 78us) tablet.cc:701] Row locks acquired
0924 02:04:22.896375 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:22.896416 (+ 41us) write_op.cc:270] Start()
0924 02:04:22.896453 (+ 37us) write_op.cc:276] Timestamp: P: 1790215462896382 usec, L: 0
0924 02:04:22.896457 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:22.896680 (+ 223us) log.cc:844] Serialized 432 byte log entry
0924 02:04:22.901367 (+ 4687us) op_driver.cc:464] REPLICATION: finished
0924 02:04:22.901522 (+ 155us) write_op.cc:301] APPLY: starting
0924 02:04:22.901540 (+ 18us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:22.901605 (+ 65us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:22.901647 (+ 42us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:22.901770 (+ 123us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:22.901816 (+ 46us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:22.901825 (+ 9us) write_op.cc:312] APPLY: finished
0924 02:04:22.901913 (+ 88us) log.cc:844] Serialized 28 byte log entry
0924 02:04:22.901981 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:22.902005 (+ 24us) write_op.cc:454] Released schema lock
0924 02:04:22.902012 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:22.902090 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:22.902094 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":397961,"Hive Metastore.run_cpu_time_us":323,"Hive Metastore.run_wall_time_us":65521,"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":559,"apply.run_wall_time_us":558,"num_ops":2,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":862,"prepare.run_wall_time_us":2098,"raft.queue_time_us":1178,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"replication_time_us":4877}]]}
I20260924 02:04:22.910266 3422 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:22.911541 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet c50b70fd127744b2942ff5d92f32295c from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:22.912122 3422 tablet_bootstrap.cc:654] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.912979 2755 master_service.cc:960] ReplaceTablet: received request to replace tablet 2911de16d0fa4f639f9121bfe5c75575 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:22.914707 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.915248 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6b94a735f453cbc7920435aa0ad28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.918485 3421 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:22.920616 3421 tablet_bootstrap.cc:654] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.922924 3276 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.923656 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6b94a735f453cbc7920435aa0ad28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.924017 3135 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.924507 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6b94a735f453cbc7920435aa0ad28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.928943 3422 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:22.929149 3422 ts_tablet_manager.cc:1403] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260924 02:04:22.930146 3422 raft_consensus.cc:359] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.930395 3422 raft_consensus.cc:385] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:22.930498 3422 raft_consensus.cc:740] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:22.930423 2753 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet c50b70fd127744b2942ff5d92f32295c
I20260924 02:04:22.930801 3422 consensus_queue.cc:260] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:22.931289 2753 catalog_manager.cc:6934] ReplaceTablet: tablet c50b70fd127744b2942ff5d92f32295c deleted and replaced by tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5
I20260924 02:04:22.931430 3422 ts_tablet_manager.cc:1434] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 02:04:22.931622 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet 93c0e16445f04a44a41fcb8584cedb9c from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:22.931951 3275 tablet_service.cc:1558] Processing DeleteTablet for tablet c50b70fd127744b2942ff5d92f32295c with delete_type TABLET_DATA_DELETED (replaced by tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:22.933386 3417 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:22.935297 3417 tablet_bootstrap.cc:654] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:22.936753 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet c50b70fd127744b2942ff5d92f32295c with delete_type TABLET_DATA_DELETED (replaced by tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:22.939023 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet c50b70fd127744b2942ff5d92f32295c with delete_type TABLET_DATA_DELETED (replaced by tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:22.943856 3443 tablet_replica.cc:333] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
W20260924 02:04:22.945080 3066 tablet.cc:2433] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 02:04:22.947649 3344 tablet.cc:2433] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 02:04:22.947448 3443 raft_consensus.cc:2243] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:22.948827 3441 tablet_replica.cc:333] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:22.950450 3443 raft_consensus.cc:2272] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:22.950682 3441 raft_consensus.cc:2243] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:22.951502 3441 raft_consensus.cc:2272] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:22.953254 3443 ts_tablet_manager.cc:1916] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:22.953331 3444 tablet_replica.cc:333] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:22.953850 3444 raft_consensus.cc:2243] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:22.954243 3444 raft_consensus.cc:2272] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:22.955850 3441 ts_tablet_manager.cc:1916] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:22.959633 3444 ts_tablet_manager.cc:1916] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:22.967239 2753 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 93c0e16445f04a44a41fcb8584cedb9c
I20260924 02:04:22.967438 3444 ts_tablet_manager.cc:1929] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:22.967638 3444 log.cc:1199] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/c50b70fd127744b2942ff5d92f32295c
I20260924 02:04:22.967932 2753 catalog_manager.cc:6934] ReplaceTablet: tablet 93c0e16445f04a44a41fcb8584cedb9c deleted and replaced by tablet 62ac1b1e60184f1095090619805dda03
I20260924 02:04:22.968180 3444 ts_tablet_manager.cc:1950] T c50b70fd127744b2942ff5d92f32295c P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:22.968739 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c with delete_type TABLET_DATA_DELETED (replaced by tablet 62ac1b1e60184f1095090619805dda03) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:22.969367 2755 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 2911de16d0fa4f639f9121bfe5c75575
I20260924 02:04:22.969650 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c with delete_type TABLET_DATA_DELETED (replaced by tablet 62ac1b1e60184f1095090619805dda03) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:22.970348 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb06864c6e94123a800742968dfbc49) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:22.970602 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb06864c6e94123a800742968dfbc49) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:22.970752 2997 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c0e16445f04a44a41fcb8584cedb9c with delete_type TABLET_DATA_DELETED (replaced by tablet 62ac1b1e60184f1095090619805dda03) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:22.971432 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 2911de16d0fa4f639f9121bfe5c75575 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb06864c6e94123a800742968dfbc49) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:22.978674 3443 ts_tablet_manager.cc:1929] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:22.981499 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.982180 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.991531 3441 ts_tablet_manager.cc:1929] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:22.992262 3422 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:22.983614 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:22.995260 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:22.996912 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet c50b70fd127744b2942ff5d92f32295c (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:22.997735 3422 tablet_bootstrap.cc:654] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.002275 3444 tablet_replica.cc:333] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:23.002514 3444 raft_consensus.cc:2243] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:23.002702 3444 raft_consensus.cc:2272] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.003029 3443 log.cc:1199] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/c50b70fd127744b2942ff5d92f32295c
I20260924 02:04:23.003647 3443 ts_tablet_manager.cc:1950] T c50b70fd127744b2942ff5d92f32295c P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:23.004426 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet 2911de16d0fa4f639f9121bfe5c75575 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:23.004961 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet 93c0e16445f04a44a41fcb8584cedb9c from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:23.005484 2753 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_b81c77bac5c04d7c964e800c79c26424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:23.006147 3441 log.cc:1199] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/c50b70fd127744b2942ff5d92f32295c
I20260924 02:04:23.006688 3441 ts_tablet_manager.cc:1950] T c50b70fd127744b2942ff5d92f32295c P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:23.008543 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac1b1e60184f1095090619805dda03 (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.008846 3444 ts_tablet_manager.cc:1916] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.009122 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac1b1e60184f1095090619805dda03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.011188 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb06864c6e94123a800742968dfbc49 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.011292 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac1b1e60184f1095090619805dda03 (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.011670 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb06864c6e94123a800742968dfbc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.011715 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac1b1e60184f1095090619805dda03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.016127 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb06864c6e94123a800742968dfbc49 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.016693 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb06864c6e94123a800742968dfbc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.024134 3276 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb06864c6e94123a800742968dfbc49 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.024664 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb06864c6e94123a800742968dfbc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.025579 3422 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.025796 3422 ts_tablet_manager.cc:1403] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.006s
I20260924 02:04:23.026674 3422 raft_consensus.cc:359] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.026927 3422 raft_consensus.cc:385] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.027040 3422 raft_consensus.cc:740] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.011188 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 62ac1b1e60184f1095090619805dda03 (DEFAULT_TABLE table=default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.027904 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ac1b1e60184f1095090619805dda03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.027381 3422 consensus_queue.cc:260] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.032601 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet c50b70fd127744b2942ff5d92f32295c (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:23.033151 3443 tablet_replica.cc:333] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:23.033402 3443 raft_consensus.cc:2243] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:23.033617 3443 raft_consensus.cc:2272] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.035003 3441 tablet_replica.cc:333] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:23.035472 3441 raft_consensus.cc:2243] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:23.035732 3441 raft_consensus.cc:2272] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.036239 3422 ts_tablet_manager.cc:1434] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260924 02:04:23.037011 3443 ts_tablet_manager.cc:1916] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.039000 3441 ts_tablet_manager.cc:1916] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.040128 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet c50b70fd127744b2942ff5d92f32295c (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:23.045728 3422 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.048034 3422 tablet_bootstrap.cc:654] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.048672 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.049348 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.054564 3444 ts_tablet_manager.cc:1929] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:23.058174 3441 ts_tablet_manager.cc:1929] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:23.058377 3441 log.cc:1199] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/93c0e16445f04a44a41fcb8584cedb9c
I20260924 02:04:23.058841 3441 ts_tablet_manager.cc:1950] T 93c0e16445f04a44a41fcb8584cedb9c P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:23.059957 2755 catalog_manager.cc:6934] ReplaceTablet: tablet 2911de16d0fa4f639f9121bfe5c75575 deleted and replaced by tablet 8fb06864c6e94123a800742968dfbc49
I20260924 02:04:23.067970 3441 tablet_replica.cc:333] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:23.068219 3441 raft_consensus.cc:2243] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:23.068251 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 93c0e16445f04a44a41fcb8584cedb9c (table default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:23.068466 3441 raft_consensus.cc:2272] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.075340 3417 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.075661 3417 ts_tablet_manager.cc:1403] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.142s user 0.004s sys 0.008s
I20260924 02:04:23.077379 2755 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_a03adf7b11ae4b39ac0273d0e3cf5142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:23.079499 3441 ts_tablet_manager.cc:1916] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.076660 3417 raft_consensus.cc:359] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.080291 3417 raft_consensus.cc:385] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.080534 3417 raft_consensus.cc:740] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.080945 3417 consensus_queue.cc:260] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.081650 3417 ts_tablet_manager.cc:1434] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260924 02:04:23.083069 3422 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.083328 3422 ts_tablet_manager.cc:1403] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.005s
I20260924 02:04:23.084184 3422 raft_consensus.cc:359] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.084456 3422 raft_consensus.cc:385] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.084573 3422 raft_consensus.cc:740] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.084857 3421 tablet_bootstrap.cc:492] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.084844 3422 consensus_queue.cc:260] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.085114 3421 ts_tablet_manager.cc:1403] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.167s user 0.009s sys 0.003s
I20260924 02:04:23.085393 3422 ts_tablet_manager.cc:1434] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 02:04:23.085765 3422 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.086112 3421 raft_consensus.cc:359] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.086426 3421 raft_consensus.cc:385] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.086551 3421 raft_consensus.cc:740] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.086858 3421 consensus_queue.cc:260] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.091508 3421 ts_tablet_manager.cc:1434] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260924 02:04:23.093755 3421 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.094147 3422 tablet_bootstrap.cc:654] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.084512 3443 ts_tablet_manager.cc:1929] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:23.094743 3443 log.cc:1199] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/2911de16d0fa4f639f9121bfe5c75575
I20260924 02:04:23.083045 3444 log.cc:1199] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/93c0e16445f04a44a41fcb8584cedb9c
I20260924 02:04:23.095391 3443 ts_tablet_manager.cc:1950] T 2911de16d0fa4f639f9121bfe5c75575 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:23.095534 3444 ts_tablet_manager.cc:1950] T 93c0e16445f04a44a41fcb8584cedb9c P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:23.096722 3443 tablet_replica.cc:333] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:23.096938 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 2911de16d0fa4f639f9121bfe5c75575 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:23.097333 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 93c0e16445f04a44a41fcb8584cedb9c (table default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:23.099174 3444 tablet_replica.cc:333] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:23.099684 3444 raft_consensus.cc:2243] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:23.100495 3444 pending_rounds.cc:70] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Trying to abort 1 pending ops.
I20260924 02:04:23.102222 3421 tablet_bootstrap.cc:654] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.102670 3444 pending_rounds.cc:77] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332722535647158272 op_type: NO_OP noop_request { }
I20260924 02:04:23.103258 3444 raft_consensus.cc:2889] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260924 02:04:23.103657 3444 raft_consensus.cc:2272] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.104183 3441 ts_tablet_manager.cc:1929] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:23.104347 3441 log.cc:1199] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/2911de16d0fa4f639f9121bfe5c75575
I20260924 02:04:23.104872 3441 ts_tablet_manager.cc:1950] T 2911de16d0fa4f639f9121bfe5c75575 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:23.106774 3443 raft_consensus.cc:2243] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:23.106892 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 2911de16d0fa4f639f9121bfe5c75575 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:23.107013 3443 raft_consensus.cc:2272] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:23.100334 3417 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.106487 3426 raft_consensus.cc:493] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.107242 3426 raft_consensus.cc:515] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.109338 3426 leader_election.cc:290] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.111869 3444 ts_tablet_manager.cc:1916] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.111922 3422 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.112317 3422 ts_tablet_manager.cc:1403] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.002s
I20260924 02:04:23.113472 3422 raft_consensus.cc:359] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.113821 3422 raft_consensus.cc:385] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.113981 3422 raft_consensus.cc:740] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.114338 3422 consensus_queue.cc:260] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.119182 3422 ts_tablet_manager.cc:1434] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260924 02:04:23.124395 3422 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.126904 3422 tablet_bootstrap.cc:654] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.132175 3444 ts_tablet_manager.cc:1929] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:23.132452 3444 log.cc:1199] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/2911de16d0fa4f639f9121bfe5c75575
I20260924 02:04:23.132957 3444 ts_tablet_manager.cc:1950] T 2911de16d0fa4f639f9121bfe5c75575 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:23.134615 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 2911de16d0fa4f639f9121bfe5c75575 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:23.144157 3417 tablet_bootstrap.cc:654] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.147840 3443 ts_tablet_manager.cc:1916] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:23.172556 3421 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.172835 3421 ts_tablet_manager.cc:1403] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
I20260924 02:04:23.173761 3421 raft_consensus.cc:359] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.174011 3421 raft_consensus.cc:385] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.174096 3421 raft_consensus.cc:740] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.175796 3417 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.176033 3417 ts_tablet_manager.cc:1403] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.076s user 0.000s sys 0.004s
I20260924 02:04:23.176882 3417 raft_consensus.cc:359] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.177122 3417 raft_consensus.cc:385] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.177202 3417 raft_consensus.cc:740] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.185417 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005e9901c235496cacef80d431b60cc2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.185846 3296 raft_consensus.cc:2468] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.186600 2953 leader_election.cc:304] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.187081 3426 raft_consensus.cc:2804] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.187228 3426 raft_consensus.cc:493] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.187345 3426 raft_consensus.cc:3060] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.190701 3426 raft_consensus.cc:515] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.191946 3426 leader_election.cc:290] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.192675 2748 catalog_manager.cc:2213] created HMS catalog entry for table [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:23.192997 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005e9901c235496cacef80d431b60cc2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.193305 3296 raft_consensus.cc:3060] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.200837 2748 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 9) took 1409 ms. Trace:
I20260924 02:04:23.201037 2748 rpcz_store.cc:276] 0924 02:04:21.791503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.791561 (+ 58us) service_pool.cc:224] Handling call
0924 02:04:22.431884 (+640323us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.432309 (+ 425us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:23.192612 (+760303us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:23.200445 (+ 7833us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:23.200582 (+ 137us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:23.200755 (+ 173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:23.193550 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:23.193716 (+ 166us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:23.193725 (+ 9us) write_op.cc:435] Acquired schema lock
0924 02:04:23.193728 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:23.193870 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:23.193887 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:23.193891 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:23.193984 (+ 93us) tablet.cc:701] Row locks acquired
0924 02:04:23.193987 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:23.194029 (+ 42us) write_op.cc:270] Start()
0924 02:04:23.194067 (+ 38us) write_op.cc:276] Timestamp: P: 1790215463194004 usec, L: 0
0924 02:04:23.194071 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:23.194285 (+ 214us) log.cc:844] Serialized 432 byte log entry
0924 02:04:23.199595 (+ 5310us) op_driver.cc:464] REPLICATION: finished
0924 02:04:23.199803 (+ 208us) write_op.cc:301] APPLY: starting
0924 02:04:23.199829 (+ 26us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:23.199885 (+ 56us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:23.199931 (+ 46us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:23.200053 (+ 122us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:23.200093 (+ 40us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:23.200100 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:23.200193 (+ 93us) log.cc:844] Serialized 28 byte log entry
0924 02:04:23.200291 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.200318 (+ 27us) write_op.cc:454] Released schema lock
0924 02:04:23.200325 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:23.200418 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.200421 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":462505,"Hive Metastore.run_cpu_time_us":312,"Hive Metastore.run_wall_time_us":297292,"child_traces":[["op",{"apply.queue_time_us":140,"apply.run_cpu_time_us":604,"apply.run_wall_time_us":604,"num_ops":2,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":880,"prepare.run_wall_time_us":880,"raft.queue_time_us":1352,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":322,"replication_time_us":5481}]]}
I20260924 02:04:23.205030 3296 raft_consensus.cc:2468] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.216574 2748 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_4da96035b3984c33b90f53644baa2a0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:23.217913 3274 tablet_service.cc:1511] Processing CreateTablet for tablet d12d26db47694d7387bc01063f987fd6 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.218537 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d26db47694d7387bc01063f987fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.223574 2953 leader_election.cc:304] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.223809 2997 tablet_service.cc:1511] Processing CreateTablet for tablet d12d26db47694d7387bc01063f987fd6 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.224004 3426 raft_consensus.cc:2804] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.224401 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d26db47694d7387bc01063f987fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.227811 3135 tablet_service.cc:1511] Processing CreateTablet for tablet d12d26db47694d7387bc01063f987fd6 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.228413 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d26db47694d7387bc01063f987fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.228890 3421 consensus_queue.cc:260] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.235944 3417 consensus_queue.cc:260] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.236297 3157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005e9901c235496cacef80d431b60cc2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.236917 3157 raft_consensus.cc:2468] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.237720 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "005e9901c235496cacef80d431b60cc2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.238058 3156 raft_consensus.cc:3060] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.241426 3156 raft_consensus.cc:2468] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.237871 3422 tablet_bootstrap.cc:492] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.242087 3422 ts_tablet_manager.cc:1403] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.118s user 0.010s sys 0.037s
I20260924 02:04:23.243278 3422 raft_consensus.cc:359] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.243737 3422 raft_consensus.cc:385] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.244007 3422 raft_consensus.cc:740] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.244324 3422 consensus_queue.cc:260] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.244722 3421 ts_tablet_manager.cc:1434] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.072s user 0.003s sys 0.000s
I20260924 02:04:23.246402 3422 ts_tablet_manager.cc:1434] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260924 02:04:23.246753 3422 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.251268 3422 tablet_bootstrap.cc:654] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.253038 3426 raft_consensus.cc:697] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:23.254022 3426 consensus_queue.cc:237] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.261844 3421 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.271647 3417 ts_tablet_manager.cc:1434] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.095s user 0.002s sys 0.001s
I20260924 02:04:23.273137 3417 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.276036 3417 tablet_bootstrap.cc:654] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.277419 3422 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.277741 3422 ts_tablet_manager.cc:1403] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.009s
I20260924 02:04:23.278764 3443 ts_tablet_manager.cc:1929] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:23.278692 3422 raft_consensus.cc:359] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.279102 3422 raft_consensus.cc:385] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.279244 3422 raft_consensus.cc:740] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.279651 3422 consensus_queue.cc:260] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.281361 3422 ts_tablet_manager.cc:1434] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260924 02:04:23.284201 3421 tablet_bootstrap.cc:654] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.278939 3443 log.cc:1199] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/93c0e16445f04a44a41fcb8584cedb9c
I20260924 02:04:23.286890 3443 ts_tablet_manager.cc:1950] T 93c0e16445f04a44a41fcb8584cedb9c P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:23.288170 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 93c0e16445f04a44a41fcb8584cedb9c (table default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:23.300712 3417 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.300911 3417 ts_tablet_manager.cc:1403] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260924 02:04:23.301766 3417 raft_consensus.cc:359] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.302017 3417 raft_consensus.cc:385] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.302109 3417 raft_consensus.cc:740] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.303375 3417 consensus_queue.cc:260] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.305843 3417 ts_tablet_manager.cc:1434] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260924 02:04:23.308010 3417 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.310390 3417 tablet_bootstrap.cc:654] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.313771 3421 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.314019 3421 ts_tablet_manager.cc:1403] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.000s
I20260924 02:04:23.315014 3421 raft_consensus.cc:359] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.315263 3421 raft_consensus.cc:385] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.315399 3421 raft_consensus.cc:740] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.315762 3421 consensus_queue.cc:260] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.324981 3421 ts_tablet_manager.cc:1434] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260924 02:04:23.329548 3421 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.332779 3421 tablet_bootstrap.cc:654] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.343521 3417 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.343940 3417 ts_tablet_manager.cc:1403] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.008s
I20260924 02:04:23.344933 3417 raft_consensus.cc:359] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.345175 3417 raft_consensus.cc:385] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.345391 3417 raft_consensus.cc:740] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.346357 3417 consensus_queue.cc:260] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.348670 3417 ts_tablet_manager.cc:1434] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260924 02:04:23.350478 3417 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.352680 3417 tablet_bootstrap.cc:654] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.355505 3421 tablet_bootstrap.cc:492] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.355749 3421 ts_tablet_manager.cc:1403] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.001s
I20260924 02:04:23.356849 3421 raft_consensus.cc:359] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.357141 3421 raft_consensus.cc:385] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.357231 3421 raft_consensus.cc:740] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.357610 3421 consensus_queue.cc:260] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.359751 2749 catalog_manager.cc:2213] created HMS catalog entry for table [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:23.366644 3421 ts_tablet_manager.cc:1434] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260924 02:04:23.368932 2749 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 8) took 1578 ms. Trace:
I20260924 02:04:23.369112 2749 rpcz_store.cc:276] 0924 02:04:21.790799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.791010 (+ 211us) service_pool.cc:224] Handling call
0924 02:04:22.432879 (+641869us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.433292 (+ 413us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:23.359675 (+926383us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:23.368580 (+ 8905us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:23.368720 (+ 140us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:23.368862 (+ 142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:23.361360 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:23.361546 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:23.361557 (+ 11us) write_op.cc:435] Acquired schema lock
0924 02:04:23.361561 (+ 4us) tablet.cc:662] Decoding operations
0924 02:04:23.361709 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:23.361730 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:23.361740 (+ 10us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:23.361870 (+ 130us) tablet.cc:701] Row locks acquired
0924 02:04:23.361874 (+ 4us) write_op.cc:260] PREPARE: finished
0924 02:04:23.361925 (+ 51us) write_op.cc:270] Start()
0924 02:04:23.361972 (+ 47us) write_op.cc:276] Timestamp: P: 1790215463361886 usec, L: 0
0924 02:04:23.361977 (+ 5us) op_driver.cc:348] REPLICATION: starting
0924 02:04:23.362298 (+ 321us) log.cc:844] Serialized 432 byte log entry
0924 02:04:23.367682 (+ 5384us) op_driver.cc:464] REPLICATION: finished
0924 02:04:23.367866 (+ 184us) write_op.cc:301] APPLY: starting
0924 02:04:23.367893 (+ 27us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:23.367949 (+ 56us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:23.367987 (+ 38us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:23.368145 (+ 158us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:23.368188 (+ 43us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:23.368195 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:23.368313 (+ 118us) log.cc:844] Serialized 28 byte log entry
0924 02:04:23.368420 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.368446 (+ 26us) write_op.cc:454] Released schema lock
0924 02:04:23.368456 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:23.368553 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.368557 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":758807,"Hive Metastore.run_cpu_time_us":342,"Hive Metastore.run_wall_time_us":167014,"child_traces":[["op",{"apply.queue_time_us":120,"apply.run_cpu_time_us":677,"apply.run_wall_time_us":677,"num_ops":2,"prepare.queue_time_us":726,"prepare.run_cpu_time_us":1084,"prepare.run_wall_time_us":1084,"raft.queue_time_us":1651,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":367,"replication_time_us":5662}]]}
I20260924 02:04:23.378024 3421 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.380120 3421 tablet_bootstrap.cc:654] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.381224 3425 raft_consensus.cc:493] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.381433 3425 raft_consensus.cc:515] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.382174 3425 leader_election.cc:290] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.383200 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.383140 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.383685 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0e19bdca93403c8bb502ba377fac75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 02:04:23.383849 3092 leader_election.cc:343] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:23.386229 3417 tablet_bootstrap.cc:492] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.386399 3417 ts_tablet_manager.cc:1403] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260924 02:04:23.387117 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.387370 3018 raft_consensus.cc:2468] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.387292 3417 raft_consensus.cc:359] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.387480 3417 raft_consensus.cc:385] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.387563 3417 raft_consensus.cc:740] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.387823 3417 consensus_queue.cc:260] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.387969 3135 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.388414 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0e19bdca93403c8bb502ba377fac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.389571 3417 ts_tablet_manager.cc:1434] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260924 02:04:23.390822 3417 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.391600 2749 catalog_manager.cc:5838] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:23.393021 3090 leader_election.cc:304] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters: 79827750d7ae4673803de4e9415165e6
I20260924 02:04:23.395519 3425 raft_consensus.cc:2804] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.395642 3425 raft_consensus.cc:493] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.395750 3425 raft_consensus.cc:3060] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.398674 3425 raft_consensus.cc:515] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.399408 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.399869 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0e19bdca93403c8bb502ba377fac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.403391 3422 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.405450 3422 tablet_bootstrap.cc:654] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.412851 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.412343 3425 leader_election.cc:290] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
W20260924 02:04:23.413662 3092 leader_election.cc:343] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:23.414279 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:23.414548 3018 raft_consensus.cc:3060] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.415874 2749 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_70811bdb724048a99d02b5f3d7a6f6db" } new_table_name: "default.Table_635d6d13e9ef48aca3c221ede242342e" modify_external_catalogs: true
I20260924 02:04:23.416824 3417 tablet_bootstrap.cc:654] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.421442 3421 tablet_bootstrap.cc:492] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.421703 3421 ts_tablet_manager.cc:1403] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.004s
I20260924 02:04:23.422390 3018 raft_consensus.cc:2468] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.422822 3421 raft_consensus.cc:359] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.423106 3421 raft_consensus.cc:385] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.423225 3421 raft_consensus.cc:740] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.423163 3090 leader_election.cc:304] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters: 79827750d7ae4673803de4e9415165e6
I20260924 02:04:23.423609 3425 raft_consensus.cc:2804] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.428944 3421 consensus_queue.cc:260] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.431649 3422 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.431983 3422 ts_tablet_manager.cc:1403] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.008s
I20260924 02:04:23.433004 3422 raft_consensus.cc:359] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.433336 3422 raft_consensus.cc:385] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.433490 3422 raft_consensus.cc:740] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.433933 3422 consensus_queue.cc:260] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.436056 3421 ts_tablet_manager.cc:1434] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20260924 02:04:23.441491 3421 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.444074 3421 tablet_bootstrap.cc:654] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.446805 3417 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.447090 3417 ts_tablet_manager.cc:1403] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.056s user 0.011s sys 0.001s
I20260924 02:04:23.447976 3417 raft_consensus.cc:359] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.448246 3417 raft_consensus.cc:385] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.448364 3417 raft_consensus.cc:740] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.448705 3417 consensus_queue.cc:260] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.450590 3417 ts_tablet_manager.cc:1434] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260924 02:04:23.451915 3417 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.453768 3417 tablet_bootstrap.cc:654] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.457463 3422 ts_tablet_manager.cc:1434] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.025s user 0.005s sys 0.002s
I20260924 02:04:23.457690 3425 raft_consensus.cc:697] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:23.463917 3425 consensus_queue.cc:237] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.467025 3417 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.467226 3417 ts_tablet_manager.cc:1403] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.002s
I20260924 02:04:23.468160 3417 raft_consensus.cc:359] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.468365 3417 raft_consensus.cc:385] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.468474 3417 raft_consensus.cc:740] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.468827 3417 consensus_queue.cc:260] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.470513 3421 tablet_bootstrap.cc:492] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.470710 3421 ts_tablet_manager.cc:1403] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.006s
I20260924 02:04:23.470960 3417 ts_tablet_manager.cc:1434] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260924 02:04:23.471627 3421 raft_consensus.cc:359] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.471861 3421 raft_consensus.cc:385] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.471951 3421 raft_consensus.cc:740] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.472893 3421 consensus_queue.cc:260] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.475905 3421 ts_tablet_manager.cc:1434] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260924 02:04:23.482487 3425 raft_consensus.cc:493] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.482805 3425 raft_consensus.cc:515] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.484433 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6b94a735f453cbc7920435aa0ad28" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.484724 3018 raft_consensus.cc:2468] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.485471 3090 leader_election.cc:304] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.485896 3464 raft_consensus.cc:2804] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.486012 3464 raft_consensus.cc:493] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.486115 3464 raft_consensus.cc:3060] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.488590 3421 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.489468 3464 raft_consensus.cc:515] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.490418 3421 tablet_bootstrap.cc:654] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.490993 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6b94a735f453cbc7920435aa0ad28" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:23.491235 3018 raft_consensus.cc:3060] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.493546 3428 raft_consensus.cc:493] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.493739 3428 raft_consensus.cc:515] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.494511 3018 raft_consensus.cc:2468] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.495342 3090 leader_election.cc:304] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.495832 3466 raft_consensus.cc:2804] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.495980 3428 leader_election.cc:290] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.505164 3421 tablet_bootstrap.cc:492] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.505400 3421 ts_tablet_manager.cc:1403] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20260924 02:04:23.506708 3421 raft_consensus.cc:359] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.507014 3421 raft_consensus.cc:385] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.507109 3421 raft_consensus.cc:740] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.507411 3421 consensus_queue.cc:260] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.513931 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6b94a735f453cbc7920435aa0ad28" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.514220 3296 raft_consensus.cc:3060] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.514860 2751 catalog_manager.cc:2213] created HMS catalog entry for table [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:23.518360 3296 raft_consensus.cc:2468] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.526180 2751 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 6) took 1737 ms. Trace:
I20260924 02:04:23.526371 2751 rpcz_store.cc:276] 0924 02:04:21.789137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.789868 (+ 731us) service_pool.cc:224] Handling call
0924 02:04:22.433885 (+644017us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.434311 (+ 426us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:23.514794 (+1080483us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:23.525787 (+ 10993us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:23.525966 (+ 179us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:23.526113 (+ 147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:23.518738 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:23.519000 (+ 262us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:23.519009 (+ 9us) write_op.cc:435] Acquired schema lock
0924 02:04:23.519012 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:23.519133 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:23.519153 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:23.519159 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:23.519268 (+ 109us) tablet.cc:701] Row locks acquired
0924 02:04:23.519270 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:23.519321 (+ 51us) write_op.cc:270] Start()
0924 02:04:23.519370 (+ 49us) write_op.cc:276] Timestamp: P: 1790215463519271 usec, L: 0
0924 02:04:23.519376 (+ 6us) op_driver.cc:348] REPLICATION: starting
0924 02:04:23.519659 (+ 283us) log.cc:844] Serialized 432 byte log entry
0924 02:04:23.524825 (+ 5166us) op_driver.cc:464] REPLICATION: finished
0924 02:04:23.525020 (+ 195us) write_op.cc:301] APPLY: starting
0924 02:04:23.525047 (+ 27us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:23.525112 (+ 65us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:23.525163 (+ 51us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:23.525322 (+ 159us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:23.525373 (+ 51us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:23.525385 (+ 12us) write_op.cc:312] APPLY: finished
0924 02:04:23.525514 (+ 129us) log.cc:844] Serialized 28 byte log entry
0924 02:04:23.525611 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.525647 (+ 36us) write_op.cc:454] Released schema lock
0924 02:04:23.525659 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:23.525803 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.525810 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":924875,"Hive Metastore.run_cpu_time_us":426,"Hive Metastore.run_wall_time_us":155057,"child_traces":[["op",{"apply.queue_time_us":125,"apply.run_cpu_time_us":755,"apply.run_wall_time_us":755,"num_ops":2,"prepare.queue_time_us":2911,"prepare.run_cpu_time_us":1189,"prepare.run_wall_time_us":1190,"raft.queue_time_us":634,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":341,"replication_time_us":5385}]]}
I20260924 02:04:23.530225 3421 ts_tablet_manager.cc:1434] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.025s user 0.000s sys 0.003s
I20260924 02:04:23.546525 3135 tablet_service.cc:1511] Processing CreateTablet for tablet e69bc9301d084222915283c63e3a4e9c (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.547344 2997 tablet_service.cc:1511] Processing CreateTablet for tablet e69bc9301d084222915283c63e3a4e9c (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.547143 2751 catalog_manager.cc:5838] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:23.547591 3274 tablet_service.cc:1511] Processing CreateTablet for tablet e69bc9301d084222915283c63e3a4e9c (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.547858 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bc9301d084222915283c63e3a4e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.548002 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bc9301d084222915283c63e3a4e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.555147 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bc9301d084222915283c63e3a4e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.562820 3417 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.563581 3422 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.564908 3417 tablet_bootstrap.cc:654] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.565460 3422 tablet_bootstrap.cc:654] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.575784 2751 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_db2d035430a54e0fb0680906d7f36ccd" } new_table_name: "default.Table_4fd30425787341509cfacfe3c2b7ad27" modify_external_catalogs: true
I20260924 02:04:23.583051 3428 raft_consensus.cc:493] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.583328 3428 raft_consensus.cc:515] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.584203 3428 leader_election.cc:290] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.587293 3464 leader_election.cc:290] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.590005 3417 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.590505 3417 ts_tablet_manager.cc:1403] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.004s
I20260924 02:04:23.591632 3417 raft_consensus.cc:359] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.592015 3417 raft_consensus.cc:385] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.592177 3417 raft_consensus.cc:740] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.592655 3417 consensus_queue.cc:260] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.594038 3464 raft_consensus.cc:493] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.594269 3464 raft_consensus.cc:515] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.596088 3464 leader_election.cc:290] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.596484 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.596858 3018 raft_consensus.cc:2468] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.597321 3417 ts_tablet_manager.cc:1434] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260924 02:04:23.597568 3090 leader_election.cc:304] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.600453 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.600785 3296 raft_consensus.cc:2468] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.620321 3421 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.614867 3464 raft_consensus.cc:2804] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.622062 3464 raft_consensus.cc:493] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.622493 3464 raft_consensus.cc:3060] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.623027 3421 tablet_bootstrap.cc:654] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.626588 3464 raft_consensus.cc:515] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.631524 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6b94a735f453cbc7920435aa0ad28" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.631978 3296 raft_consensus.cc:2376] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1. Re-sending same reply.
I20260924 02:04:23.634696 3425 leader_election.cc:290] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.637718 2750 catalog_manager.cc:2213] created HMS catalog entry for table [id=95b449916858461abc889ded49d01029]
I20260924 02:04:23.647379 2750 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 7) took 1858 ms. Trace:
I20260924 02:04:23.647586 2750 rpcz_store.cc:276] 0924 02:04:21.789270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.790245 (+ 975us) service_pool.cc:224] Handling call
0924 02:04:22.434917 (+644672us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.439774 (+ 4857us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:23.637641 (+1197867us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:23.647031 (+ 9390us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:23.647171 (+ 140us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:23.647307 (+ 136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:23.638814 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:23.639094 (+ 280us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:23.639106 (+ 12us) write_op.cc:435] Acquired schema lock
0924 02:04:23.639112 (+ 6us) tablet.cc:662] Decoding operations
0924 02:04:23.639275 (+ 163us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:23.639301 (+ 26us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:23.639312 (+ 11us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:23.639677 (+ 365us) tablet.cc:701] Row locks acquired
0924 02:04:23.639684 (+ 7us) write_op.cc:260] PREPARE: finished
0924 02:04:23.639763 (+ 79us) write_op.cc:270] Start()
0924 02:04:23.639825 (+ 62us) write_op.cc:276] Timestamp: P: 1790215463639726 usec, L: 0
0924 02:04:23.639831 (+ 6us) op_driver.cc:348] REPLICATION: starting
0924 02:04:23.640161 (+ 330us) log.cc:844] Serialized 432 byte log entry
0924 02:04:23.646183 (+ 6022us) op_driver.cc:464] REPLICATION: finished
0924 02:04:23.646323 (+ 140us) write_op.cc:301] APPLY: starting
0924 02:04:23.646344 (+ 21us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:23.646395 (+ 51us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:23.646441 (+ 46us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:23.646575 (+ 134us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:23.646622 (+ 47us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:23.646631 (+ 9us) write_op.cc:312] APPLY: finished
0924 02:04:23.646740 (+ 109us) log.cc:844] Serialized 28 byte log entry
0924 02:04:23.646823 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.646859 (+ 36us) write_op.cc:454] Released schema lock
0924 02:04:23.646868 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:23.647056 (+ 188us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.647062 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1074566,"Hive Metastore.run_cpu_time_us":371,"Hive Metastore.run_wall_time_us":122797,"child_traces":[["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":716,"apply.run_wall_time_us":633,"num_ops":2,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":1550,"prepare.run_wall_time_us":1550,"raft.queue_time_us":761,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":435,"replication_time_us":6313}]]}
I20260924 02:04:23.652736 3421 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.652966 3421 ts_tablet_manager.cc:1403] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.014s
I20260924 02:04:23.653879 3421 raft_consensus.cc:359] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.658651 3421 raft_consensus.cc:385] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.658855 3421 raft_consensus.cc:740] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.660276 3421 consensus_queue.cc:260] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.661021 3421 ts_tablet_manager.cc:1434] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260924 02:04:23.661927 2743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111) [suppressed 7 similar messages]
I20260924 02:04:23.663049 3426 raft_consensus.cc:493] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.663314 3426 raft_consensus.cc:515] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.664170 3426 leader_election.cc:290] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.665974 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac1b1e60184f1095090619805dda03" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.666343 3156 raft_consensus.cc:2468] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.666643 3466 raft_consensus.cc:697] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:23.667142 3466 consensus_queue.cc:237] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.668877 2997 tablet_service.cc:1511] Processing CreateTablet for tablet a0402fd077bb4f169f9af62a255d79fe (DEFAULT_TABLE table=default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.669572 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0402fd077bb4f169f9af62a255d79fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.669595 3135 tablet_service.cc:1511] Processing CreateTablet for tablet a0402fd077bb4f169f9af62a255d79fe (DEFAULT_TABLE table=default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.670153 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0402fd077bb4f169f9af62a255d79fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.672184 3422 tablet_bootstrap.cc:492] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.672595 3422 ts_tablet_manager.cc:1403] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.025s
I20260924 02:04:23.673929 3422 raft_consensus.cc:359] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.674198 3422 raft_consensus.cc:385] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.674299 3422 raft_consensus.cc:740] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.675414 3422 consensus_queue.cc:260] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.676074 3422 ts_tablet_manager.cc:1434] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260924 02:04:23.679145 3417 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.681133 3417 tablet_bootstrap.cc:654] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.683831 2750 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_65af2e2ad1fa42629241f4230f5ca9c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:23.685091 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac1b1e60184f1095090619805dda03" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.685427 3296 raft_consensus.cc:2468] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.686935 2953 leader_election.cc:304] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.687521 3426 raft_consensus.cc:2804] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.687661 3426 raft_consensus.cc:493] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.687783 3426 raft_consensus.cc:3060] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.687939 3417 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.688127 3417 ts_tablet_manager.cc:1403] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260924 02:04:23.690917 3422 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.691474 3426 raft_consensus.cc:515] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.691833 3274 tablet_service.cc:1511] Processing CreateTablet for tablet a0402fd077bb4f169f9af62a255d79fe (DEFAULT_TABLE table=default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.692570 3426 leader_election.cc:290] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.692773 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0402fd077bb4f169f9af62a255d79fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.693207 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac1b1e60184f1095090619805dda03" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.693287 3422 tablet_bootstrap.cc:654] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.693481 3296 raft_consensus.cc:3060] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.695552 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ac1b1e60184f1095090619805dda03" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.695793 3156 raft_consensus.cc:3060] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.696981 3296 raft_consensus.cc:2468] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.690590 3417 raft_consensus.cc:359] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.697270 3417 raft_consensus.cc:385] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.697386 3417 raft_consensus.cc:740] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.697678 2953 leader_election.cc:304] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.698060 3426 raft_consensus.cc:2804] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.698699 3417 consensus_queue.cc:260] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.699111 3156 raft_consensus.cc:2468] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.699311 3417 ts_tablet_manager.cc:1434] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260924 02:04:23.700829 3426 raft_consensus.cc:697] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:23.702759 3426 consensus_queue.cc:237] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.707108 3422 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.707286 3422 ts_tablet_manager.cc:1403] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.007s
I20260924 02:04:23.708150 3422 raft_consensus.cc:359] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.708379 3422 raft_consensus.cc:385] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.708470 3422 raft_consensus.cc:740] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.708726 3422 consensus_queue.cc:260] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.709247 3422 ts_tablet_manager.cc:1434] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260924 02:04:23.713793 2743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.79.254:45523, user_credentials={real_user=slave}} blocked reactor thread for 51858.6us
I20260924 02:04:23.717970 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.718302 3018 raft_consensus.cc:2468] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:23.718894 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.719291 3018 raft_consensus.cc:2393] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79827750d7ae4673803de4e9415165e6 in current term 1: Already voted for candidate c3d5f64871b3487b9705befe2938e289 in this term.
I20260924 02:04:23.720175 3229 leader_election.cc:304] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.720643 3428 raft_consensus.cc:2804] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.720767 3428 raft_consensus.cc:493] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.720901 3428 raft_consensus.cc:3060] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.725324 3428 raft_consensus.cc:515] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.726203 3428 leader_election.cc:290] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.726619 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:23.726890 3018 raft_consensus.cc:3060] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.728349 3464 leader_election.cc:290] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:23.731201 3018 raft_consensus.cc:2468] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.731897 3090 leader_election.cc:304] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.734148 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.734143 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:23.734539 3017 raft_consensus.cc:2393] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79827750d7ae4673803de4e9415165e6 in current term 1: Already voted for candidate c3d5f64871b3487b9705befe2938e289 in this term.
I20260924 02:04:23.738873 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.739430 3156 raft_consensus.cc:2393] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79827750d7ae4673803de4e9415165e6 in current term 1: Already voted for candidate c3d5f64871b3487b9705befe2938e289 in this term.
I20260924 02:04:23.741060 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c4bdf7a5cf4e5b84ac7dbd0e03c0b5" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.742429 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb06864c6e94123a800742968dfbc49" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.742697 3156 raft_consensus.cc:2393] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79827750d7ae4673803de4e9415165e6 in current term 1: Already voted for candidate c3d5f64871b3487b9705befe2938e289 in this term.
I20260924 02:04:23.744230 3230 leader_election.cc:304] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79827750d7ae4673803de4e9415165e6; no voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:23.744879 3466 raft_consensus.cc:2804] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.745080 3296 raft_consensus.cc:2393] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3d5f64871b3487b9705befe2938e289 in current term 1: Already voted for candidate 79827750d7ae4673803de4e9415165e6 in this term.
I20260924 02:04:23.745997 3466 raft_consensus.cc:697] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:23.749079 3466 consensus_queue.cc:237] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:23.749629 3428 raft_consensus.cc:3060] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.754103 3428 raft_consensus.cc:2749] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260924 02:04:23.754880 3230 leader_election.cc:304] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79827750d7ae4673803de4e9415165e6; no voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:23.755430 3428 raft_consensus.cc:2749] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260924 02:04:23.758162 3421 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.760713 3421 tablet_bootstrap.cc:654] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.778538 3421 tablet_bootstrap.cc:492] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.778888 3421 ts_tablet_manager.cc:1403] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.012s
I20260924 02:04:23.780495 3421 raft_consensus.cc:359] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.780869 3421 raft_consensus.cc:385] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.781051 3421 raft_consensus.cc:740] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.781494 3421 consensus_queue.cc:260] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.784039 3421 ts_tablet_manager.cc:1434] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260924 02:04:23.797950 2752 catalog_manager.cc:2213] created HMS catalog entry for table [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:23.803889 2752 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 5) took 2014 ms. Trace:
I20260924 02:04:23.804055 2752 rpcz_store.cc:276] 0924 02:04:21.789005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:21.789335 (+ 330us) service_pool.cc:224] Handling call
0924 02:04:22.426760 (+637425us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:22.440336 (+ 13576us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:23.797881 (+1357545us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:23.803574 (+ 5693us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:23.803702 (+ 128us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:23.803820 (+ 118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:23.798784 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:23.798968 (+ 184us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:23.798977 (+ 9us) write_op.cc:435] Acquired schema lock
0924 02:04:23.798979 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:23.799081 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:23.799097 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:23.799103 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:23.799189 (+ 86us) tablet.cc:701] Row locks acquired
0924 02:04:23.799192 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:23.799230 (+ 38us) write_op.cc:270] Start()
0924 02:04:23.799269 (+ 39us) write_op.cc:276] Timestamp: P: 1790215463799195 usec, L: 0
0924 02:04:23.799273 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:23.799473 (+ 200us) log.cc:844] Serialized 432 byte log entry
0924 02:04:23.802883 (+ 3410us) op_driver.cc:464] REPLICATION: finished
0924 02:04:23.803030 (+ 147us) write_op.cc:301] APPLY: starting
0924 02:04:23.803049 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:23.803093 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:23.803121 (+ 28us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:23.803249 (+ 128us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:23.803277 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:23.803283 (+ 6us) write_op.cc:312] APPLY: finished
0924 02:04:23.803349 (+ 66us) log.cc:844] Serialized 28 byte log entry
0924 02:04:23.803437 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.803459 (+ 22us) write_op.cc:454] Released schema lock
0924 02:04:23.803467 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:23.803546 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:23.803550 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1196883,"Hive Metastore.run_cpu_time_us":350,"Hive Metastore.run_wall_time_us":160438,"mutex_wait_us":438,"spinlock_wait_cycles":162048,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":513,"apply.run_wall_time_us":514,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":820,"prepare.run_wall_time_us":820,"raft.queue_time_us":1108,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":277,"replication_time_us":3576}]]}
I20260924 02:04:23.813057 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 6257a7b0828648b690113c2ad78260ad (DEFAULT_TABLE table=default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.813567 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6257a7b0828648b690113c2ad78260ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 02:04:23.815034 3419 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:23.815465 3419 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260924 02:04:23.816007 3135 tablet_service.cc:1511] Processing CreateTablet for tablet 6257a7b0828648b690113c2ad78260ad (DEFAULT_TABLE table=default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.816504 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6257a7b0828648b690113c2ad78260ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:23.816471 2752 catalog_manager.cc:5838] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:23.819986 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 6257a7b0828648b690113c2ad78260ad (DEFAULT_TABLE table=default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:23.820497 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6257a7b0828648b690113c2ad78260ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 02:04:23.824386 3419 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260924 02:04:23.825042 3426 raft_consensus.cc:493] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.825235 3426 raft_consensus.cc:515] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.825949 3426 leader_election.cc:290] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.826452 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0e19bdca93403c8bb502ba377fac75" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.826481 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0e19bdca93403c8bb502ba377fac75" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.826709 3296 raft_consensus.cc:2468] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.826754 3156 raft_consensus.cc:2468] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.827322 2952 leader_election.cc:304] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.827642 3426 raft_consensus.cc:2804] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.827772 3426 raft_consensus.cc:493] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.827888 3426 raft_consensus.cc:3060] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.829182 3421 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:23.831306 3421 tablet_bootstrap.cc:654] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.832707 3426 raft_consensus.cc:515] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.834236 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0e19bdca93403c8bb502ba377fac75" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.834471 3296 raft_consensus.cc:3060] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.834556 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0e19bdca93403c8bb502ba377fac75" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.834760 3156 raft_consensus.cc:3060] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.838428 3156 raft_consensus.cc:2468] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.838753 3296 raft_consensus.cc:2468] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.839015 2952 leader_election.cc:304] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.839367 3454 raft_consensus.cc:2804] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.833763 2752 catalog_manager.cc:5838] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:23.842600 3426 leader_election.cc:290] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
W20260924 02:04:23.842841 3419 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:23.843060 3419 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:23.843180 3419 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:23.843250 3419 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:23.846088 3417 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:23.848322 3417 tablet_bootstrap.cc:654] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.850358 3422 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:23.852553 3422 tablet_bootstrap.cc:654] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:23.861358 3426 raft_consensus.cc:493] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.861558 3426 raft_consensus.cc:515] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.862926 3419 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.79.254
--webserver_port=39869
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:23.863150 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12d26db47694d7387bc01063f987fd6" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.863467 3296 raft_consensus.cc:2468] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.864195 2953 leader_election.cc:304] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.866117 3419 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:23.867431 3417 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:23.867781 3417 ts_tablet_manager.cc:1403] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.004s
I20260924 02:04:23.868243 3466 raft_consensus.cc:493] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.868430 3466 raft_consensus.cc:515] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.869321 3466 leader_election.cc:290] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:23.869680 3419 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260924 02:04:23.870566 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0402fd077bb4f169f9af62a255d79fe" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.869325 3417 raft_consensus.cc:359] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.870921 3296 raft_consensus.cc:2468] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.871171 3417 raft_consensus.cc:385] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.871670 3092 leader_election.cc:304] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:23.871889 3417 raft_consensus.cc:740] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.872057 3466 raft_consensus.cc:2804] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.872174 3466 raft_consensus.cc:493] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.872282 3466 raft_consensus.cc:3060] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.872757 2752 catalog_manager.cc:5838] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:23.873322 3417 consensus_queue.cc:260] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.876663 3466 raft_consensus.cc:515] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.878540 3466 leader_election.cc:290] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:23.879011 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0402fd077bb4f169f9af62a255d79fe" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.879254 3296 raft_consensus.cc:3060] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.883697 3417 ts_tablet_manager.cc:1434] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260924 02:04:23.890910 2752 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_907164ea3ff94d82b3bcf3280de38fbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:23.891325 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12d26db47694d7387bc01063f987fd6" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.891842 3495 raft_consensus.cc:493] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:23.891942 3156 raft_consensus.cc:2468] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.892161 3495 raft_consensus.cc:515] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.893123 3495 leader_election.cc:290] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.893407 3495 raft_consensus.cc:2804] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.893570 3495 raft_consensus.cc:493] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.893718 3495 raft_consensus.cc:3060] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.893699 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bc9301d084222915283c63e3a4e9c" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:23.893922 3156 raft_consensus.cc:2468] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.894541 2952 leader_election.cc:304] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.890787 3426 leader_election.cc:290] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.898068 3426 raft_consensus.cc:2804] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:23.898192 3426 raft_consensus.cc:493] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:23.898295 3426 raft_consensus.cc:3060] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.899061 3495 raft_consensus.cc:515] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.900014 3495 leader_election.cc:290] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.900425 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12d26db47694d7387bc01063f987fd6" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.900651 3156 raft_consensus.cc:3060] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.902630 3156 raft_consensus.cc:2468] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.903260 2952 leader_election.cc:304] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.903990 3495 raft_consensus.cc:2804] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.904152 3495 raft_consensus.cc:697] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:23.904580 3495 consensus_queue.cc:237] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.905146 3296 raft_consensus.cc:2468] T a0402fd077bb4f169f9af62a255d79fe P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.905710 3092 leader_election.cc:304] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:23.906390 3466 raft_consensus.cc:2804] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.908970 3466 raft_consensus.cc:697] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:23.909415 3466 consensus_queue.cc:237] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.921696 3426 raft_consensus.cc:515] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.924194 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bc9301d084222915283c63e3a4e9c" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:23.924564 3156 raft_consensus.cc:3060] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.929438 3156 raft_consensus.cc:2468] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.930351 2952 leader_election.cc:304] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:23.939368 3494 raft_consensus.cc:2804] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:23.939576 3494 raft_consensus.cc:697] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:23.940001 3494 consensus_queue.cc:237] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
W20260924 02:04:23.947325 2953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.79.195:43417, user_credentials={real_user=slave}} blocked reactor thread for 83160.5us
I20260924 02:04:23.949133 3295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12d26db47694d7387bc01063f987fd6" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.949514 3295 raft_consensus.cc:3060] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.953714 3295 raft_consensus.cc:2468] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:23.955017 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bc9301d084222915283c63e3a4e9c" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:23.955407 3296 raft_consensus.cc:2468] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:23.959372 3422 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:23.959765 3422 ts_tablet_manager.cc:1403] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.005s
I20260924 02:04:23.961279 3422 raft_consensus.cc:359] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.961741 3422 raft_consensus.cc:385] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.961890 3422 raft_consensus.cc:740] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.964177 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0402fd077bb4f169f9af62a255d79fe" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:23.964525 3017 raft_consensus.cc:2468] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:23.965646 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0402fd077bb4f169f9af62a255d79fe" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:23.966403 3017 raft_consensus.cc:3060] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.972024 3017 raft_consensus.cc:2468] T a0402fd077bb4f169f9af62a255d79fe P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:23.973033 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bc9301d084222915283c63e3a4e9c" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:23.973456 3296 raft_consensus.cc:3060] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:23.991493 3426 leader_election.cc:290] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:23.993135 3454 raft_consensus.cc:697] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:23.995699 3421 tablet_bootstrap.cc:492] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:23.996006 3421 ts_tablet_manager.cc:1403] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.167s user 0.010s sys 0.032s
I20260924 02:04:23.995549 3454 consensus_queue.cc:237] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.997665 3421 raft_consensus.cc:359] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.997987 3421 raft_consensus.cc:385] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:23.998091 3421 raft_consensus.cc:740] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:23.998484 3421 consensus_queue.cc:260] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:23.998981 3422 consensus_queue.cc:260] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:24.002928 3421 ts_tablet_manager.cc:1434] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260924 02:04:24.007501 3422 ts_tablet_manager.cc:1434] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.048s user 0.000s sys 0.003s
I20260924 02:04:24.006807 3296 raft_consensus.cc:2468] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
W20260924 02:04:24.026361 3503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:24.028895 3497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:24.032629 3505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:24.038839 3419 server_base.cc:1061] running on GCE node
I20260924 02:04:24.040007 3419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:24.044270 3419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:24.060030 3419 hybrid_clock.cc:648] HybridClock initialized: now 1790215464059893 us; error 95 us; skew 500 ppm
I20260924 02:04:24.061285 3419 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:24.093962 3419 webserver.cc:533] Webserver started at http://127.2.79.254:39869/ using document root <none> and password file <none>
I20260924 02:04:24.095422 3419 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:24.095659 3419 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:24.121084 3419 fs_manager.cc:714] Time spent opening directory manager: real 0.022s user 0.009s sys 0.005s
I20260924 02:04:24.144007 3511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:24.145061 3495 raft_consensus.cc:493] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:24.145277 3495 raft_consensus.cc:515] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:24.146073 3495 leader_election.cc:290] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:24.146695 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6257a7b0828648b690113c2ad78260ad" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:24.146940 3296 raft_consensus.cc:2468] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:24.147401 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6257a7b0828648b690113c2ad78260ad" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:24.147615 3156 raft_consensus.cc:2468] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:24.148290 2952 leader_election.cc:304] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:24.149144 3495 raft_consensus.cc:2804] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:24.149252 3495 raft_consensus.cc:493] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:24.149358 3495 raft_consensus.cc:3060] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:24.152421 3495 raft_consensus.cc:515] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:24.154400 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6257a7b0828648b690113c2ad78260ad" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:24.154649 3296 raft_consensus.cc:3060] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:24.157747 3296 raft_consensus.cc:2468] T 6257a7b0828648b690113c2ad78260ad P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:24.158697 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6257a7b0828648b690113c2ad78260ad" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:24.158931 3156 raft_consensus.cc:3060] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:24.162245 3156 raft_consensus.cc:2468] T 6257a7b0828648b690113c2ad78260ad P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:24.163079 2953 leader_election.cc:304] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:24.163533 3454 raft_consensus.cc:2804] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:24.163694 3454 raft_consensus.cc:697] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:24.163976 3454 consensus_queue.cc:237] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:24.169343 3495 leader_election.cc:290] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:24.170548 3419 fs_manager.cc:730] Time spent opening block manager: real 0.043s user 0.005s sys 0.001s
I20260924 02:04:24.172245 3419 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:24.175074 3419 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:24.224028 3454 consensus_queue.cc:1048] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.283574 2756 catalog_manager.cc:3541] renamed table default.table_528cbec5084a4988ba0fd4a1f3b9ad2a [id=d26b20efde04498ab7e76f79cd6840ab] in HMS: new name default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0
W20260924 02:04:24.286938 2753 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b81c77bac5c04d7c964e800c79c26424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:24.287093 2748 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4da96035b3984c33b90f53644baa2a0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:24.288235 2755 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a03adf7b11ae4b39ac0273d0e3cf5142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:24.289907 2750 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_65af2e2ad1fa42629241f4230f5ca9c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 02:04:24.295169 3495 consensus_queue.cc:1048] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 02:04:24.321458 2752 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_907164ea3ff94d82b3bcf3280de38fbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 02:04:24.324203 2756 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 11) took 1818 ms. Trace:
I20260924 02:04:24.324390 2756 rpcz_store.cc:276] 0924 02:04:22.506090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:22.508320 (+ 2230us) service_pool.cc:224] Handling call
0924 02:04:23.842804 (+1334484us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:24.323274 (+480470us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:24.323696 (+ 422us) catalog_manager.cc:3764] Apply alter schema
0924 02:04:24.324125 (+ 429us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6056,"Hive Metastore.run_cpu_time_us":1214,"Hive Metastore.run_wall_time_us":433735}
I20260924 02:04:24.326009 2756 catalog_manager.cc:5838] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:24.344866 2756 catalog_manager.cc:5838] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:24.350888 3466 consensus_queue.cc:1048] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.374143 3464 consensus_queue.cc:1048] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.392931 3295 raft_consensus.cc:1275] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:24.393841 2754 catalog_manager.cc:3541] renamed table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8] in HMS: new name default.table_685250380f8543c9bbaeca23f7d90fef
I20260924 02:04:24.394433 3454 consensus_queue.cc:1048] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.398178 2792 master_runner.cc:187] Error getting master registration for 127.2.79.254:45523: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111),
I20260924 02:04:24.398345 2792 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:24.407719 3419 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:24.410396 3419 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:24.410902 3419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:24.412253 3157 raft_consensus.cc:1275] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:24.413105 3454 consensus_queue.cc:1048] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.429427 3518 mvcc.cc:204] Tried to move back new op lower bound from 7332722542132760576 to 7332722539329978368. Current Snapshot: MvccSnapshot[applied={T|T < 7332722542132760576}]
I20260924 02:04:24.433861 2756 catalog_manager.cc:5838] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:24.434729 2756 catalog_manager.cc:5838] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:24.435638 2756 catalog_manager.cc:5838] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:24.448719 3529 tablet.cc:1751] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:24.452925 3519 mvcc.cc:204] Tried to move back new op lower bound from 7332722542132760576 to 7332722539329978368. Current Snapshot: MvccSnapshot[applied={T|T < 7332722542132760576}]
I20260924 02:04:24.466913 3530 tablet.cc:1751] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:24.481604 2756 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:24.486532 3531 tablet.cc:1751] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:24.485865 2753 catalog_manager.cc:2213] created HMS catalog entry for table [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:24.493695 2753 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 19) took 1788 ms. Trace:
I20260924 02:04:24.493829 2753 rpcz_store.cc:276] 0924 02:04:22.705554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.005289 (+299735us) service_pool.cc:224] Handling call
0924 02:04:24.287141 (+1281852us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:24.287739 (+ 598us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:24.485830 (+198091us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:24.493397 (+ 7567us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:24.493512 (+ 115us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:24.493632 (+ 120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.487843 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.487977 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.487984 (+ 7us) write_op.cc:435] Acquired schema lock
0924 02:04:24.487986 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.488080 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.488095 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.488099 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.488184 (+ 85us) tablet.cc:701] Row locks acquired
0924 02:04:24.488186 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:24.488227 (+ 41us) write_op.cc:270] Start()
0924 02:04:24.488265 (+ 38us) write_op.cc:276] Timestamp: P: 1790215464488191 usec, L: 0
0924 02:04:24.488269 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.488463 (+ 194us) log.cc:844] Serialized 432 byte log entry
0924 02:04:24.492270 (+ 3807us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.492686 (+ 416us) write_op.cc:301] APPLY: starting
0924 02:04:24.492704 (+ 18us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.492749 (+ 45us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.492776 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.492939 (+ 163us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.492977 (+ 38us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:24.492984 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:24.493067 (+ 83us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.493134 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.493157 (+ 23us) write_op.cc:454] Released schema lock
0924 02:04:24.493164 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:24.493236 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.493240 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":105878,"Hive Metastore.run_cpu_time_us":344,"Hive Metastore.run_wall_time_us":91801,"child_traces":[["op",{"apply.queue_time_us":347,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":549,"num_ops":2,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":762,"prepare.run_wall_time_us":763,"raft.queue_time_us":1307,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":273,"replication_time_us":3968}]]}
I20260924 02:04:24.495611 2753 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:24.506985 2756 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:24.520236 2997 tablet_service.cc:1511] Processing CreateTablet for tablet dc9c9a9031cb48c3a7844134859b347b (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.520788 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9c9a9031cb48c3a7844134859b347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.524006 3274 tablet_service.cc:1511] Processing CreateTablet for tablet dc9c9a9031cb48c3a7844134859b347b (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.524529 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9c9a9031cb48c3a7844134859b347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.537351 2753 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab] alter complete (version 1)
I20260924 02:04:24.539335 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fb06864c6e94123a800742968dfbc49 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:24.542150 2756 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_f021dac94f15432cac9fc0e59d54b0be" } modify_external_catalogs: true
I20260924 02:04:24.542466 2756 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_f021dac94f15432cac9fc0e59d54b0be" } modify_external_catalogs: true
W20260924 02:04:24.554236 2743 consensus_peers.cc:597] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 -> Peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Couldn't send request to peer 9b31e7e4c8ff4e30980f19a91551e618. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260924 02:04:24.558341 2753 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 8fb06864c6e94123a800742968dfbc49
I20260924 02:04:24.559485 2998 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb06864c6e94123a800742968dfbc49 with delete_type TABLET_DATA_DELETED (replaced by tablet 958ced04a94b47aebff1f92b0f32ccf2) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:24.567479 3276 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb06864c6e94123a800742968dfbc49 with delete_type TABLET_DATA_DELETED (replaced by tablet 958ced04a94b47aebff1f92b0f32ccf2) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:24.589213 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 958ced04a94b47aebff1f92b0f32ccf2 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.589754 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958ced04a94b47aebff1f92b0f32ccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.591504 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 958ced04a94b47aebff1f92b0f32ccf2 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.591977 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958ced04a94b47aebff1f92b0f32ccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.592815 2748 catalog_manager.cc:2213] created HMS catalog entry for table [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:24.607599 2748 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 21) took 1778 ms. Trace:
I20260924 02:04:24.607738 2748 rpcz_store.cc:276] 0924 02:04:22.829424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.216382 (+386958us) service_pool.cc:224] Handling call
0924 02:04:24.287214 (+1070832us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:24.287732 (+ 518us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:24.592785 (+305053us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:24.607196 (+ 14411us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:24.607326 (+ 130us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:24.607508 (+ 182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.601728 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.601874 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.601881 (+ 7us) write_op.cc:435] Acquired schema lock
0924 02:04:24.601883 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.602006 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.602024 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.602031 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.602127 (+ 96us) tablet.cc:701] Row locks acquired
0924 02:04:24.602130 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:24.602201 (+ 71us) write_op.cc:270] Start()
0924 02:04:24.602240 (+ 39us) write_op.cc:276] Timestamp: P: 1790215464602164 usec, L: 0
0924 02:04:24.602245 (+ 5us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.602493 (+ 248us) log.cc:844] Serialized 432 byte log entry
0924 02:04:24.606460 (+ 3967us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.606634 (+ 174us) write_op.cc:301] APPLY: starting
0924 02:04:24.606653 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.606697 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.606731 (+ 34us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.606858 (+ 127us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.606892 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:24.606899 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:24.607010 (+ 111us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.607080 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.607103 (+ 23us) write_op.cc:454] Released schema lock
0924 02:04:24.607111 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:24.607194 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.607198 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":197717,"Hive Metastore.run_cpu_time_us":301,"Hive Metastore.run_wall_time_us":106792,"mutex_wait_us":2,"spinlock_wait_cycles":34432,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":550,"apply.run_wall_time_us":549,"num_ops":2,"prepare.queue_time_us":8206,"prepare.run_cpu_time_us":946,"prepare.run_wall_time_us":1737,"raft.queue_time_us":427,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":295,"replication_time_us":4160}]]}
I20260924 02:04:24.608469 2748 master_service.cc:960] ReplaceTablet: received request to replace tablet 005e9901c235496cacef80d431b60cc2 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:24.617877 2748 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 005e9901c235496cacef80d431b60cc2
I20260924 02:04:24.618546 2748 catalog_manager.cc:6934] ReplaceTablet: tablet 005e9901c235496cacef80d431b60cc2 deleted and replaced by tablet 057be33fa10b4480b69af12f3800ce80
I20260924 02:04:24.618719 2748 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52768 (request call id 28) took 1389 ms. Trace:
I20260924 02:04:24.620217 2753 catalog_manager.cc:6934] ReplaceTablet: tablet 8fb06864c6e94123a800742968dfbc49 deleted and replaced by tablet 958ced04a94b47aebff1f92b0f32ccf2
I20260924 02:04:24.620919 2753 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52768 (request call id 26) took 1480 ms. Trace:
I20260924 02:04:24.618839 2748 rpcz_store.cc:276] 0924 02:04:23.229249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.608385 (+1379136us) service_pool.cc:224] Handling call
0924 02:04:24.618674 (+ 10289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.610794 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.610919 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.610925 (+ 6us) write_op.cc:435] Acquired schema lock
0924 02:04:24.610927 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.611062 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.611075 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.611080 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.611165 (+ 85us) tablet.cc:701] Row locks acquired
0924 02:04:24.611168 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:24.611207 (+ 39us) write_op.cc:270] Start()
0924 02:04:24.611239 (+ 32us) write_op.cc:276] Timestamp: P: 1790215464611197 usec, L: 0
0924 02:04:24.611242 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.611480 (+ 238us) log.cc:844] Serialized 658 byte log entry
0924 02:04:24.616715 (+ 5235us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.616980 (+ 265us) write_op.cc:301] APPLY: starting
0924 02:04:24.617002 (+ 22us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.617082 (+ 80us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.617119 (+ 37us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.617214 (+ 95us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.617260 (+ 46us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:24.617265 (+ 5us) write_op.cc:312] APPLY: finished
0924 02:04:24.617345 (+ 80us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.617449 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.617471 (+ 22us) write_op.cc:454] Released schema lock
0924 02:04:24.617479 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:24.617562 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.617566 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195,"apply.run_cpu_time_us":575,"apply.run_wall_time_us":575,"num_ops":2,"prepare.queue_time_us":1052,"prepare.run_cpu_time_us":826,"prepare.run_wall_time_us":1611,"raft.queue_time_us":67,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":287,"replication_time_us":5437}]]}
I20260924 02:04:24.621336 2753 rpcz_store.cc:276] 0924 02:04:23.140215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.539203 (+1398988us) service_pool.cc:224] Handling call
0924 02:04:24.620417 (+ 81214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.542623 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.542777 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.542785 (+ 8us) write_op.cc:435] Acquired schema lock
0924 02:04:24.542787 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.542912 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.542929 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.542934 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.543053 (+ 119us) tablet.cc:701] Row locks acquired
0924 02:04:24.543056 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:24.543103 (+ 47us) write_op.cc:270] Start()
0924 02:04:24.543143 (+ 40us) write_op.cc:276] Timestamp: P: 1790215464543063 usec, L: 0
0924 02:04:24.543146 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.543417 (+ 271us) log.cc:844] Serialized 658 byte log entry
0924 02:04:24.551843 (+ 8426us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.554789 (+ 2946us) write_op.cc:301] APPLY: starting
0924 02:04:24.554817 (+ 28us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.554882 (+ 65us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.554935 (+ 53us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.555114 (+ 179us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.555189 (+ 75us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:24.555198 (+ 9us) write_op.cc:312] APPLY: finished
0924 02:04:24.555345 (+ 147us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.555430 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.555462 (+ 32us) write_op.cc:454] Released schema lock
0924 02:04:24.555471 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:24.555565 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.555570 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2846,"apply.run_cpu_time_us":775,"apply.run_wall_time_us":775,"num_ops":2,"prepare.queue_time_us":1776,"prepare.run_cpu_time_us":1001,"prepare.run_wall_time_us":3103,"raft.queue_time_us":743,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":392,"replication_time_us":8648}]]}
I20260924 02:04:24.621996 2753 master_service.cc:960] ReplaceTablet: received request to replace tablet 62ac1b1e60184f1095090619805dda03 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:24.622912 2748 master_service.cc:960] ReplaceTablet: received request to replace tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:24.501896 3464 consensus_queue.cc:1048] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.624359 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet 005e9901c235496cacef80d431b60cc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 057be33fa10b4480b69af12f3800ce80) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:24.625263 3273 tablet_service.cc:1558] Processing DeleteTablet for tablet 005e9901c235496cacef80d431b60cc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 057be33fa10b4480b69af12f3800ce80) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:24.519146 3135 tablet_service.cc:1511] Processing CreateTablet for tablet dc9c9a9031cb48c3a7844134859b347b (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.629104 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc9c9a9031cb48c3a7844134859b347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.566373 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fb06864c6e94123a800742968dfbc49 with delete_type TABLET_DATA_DELETED (replaced by tablet 958ced04a94b47aebff1f92b0f32ccf2) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:24.590131 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 958ced04a94b47aebff1f92b0f32ccf2 (DEFAULT_TABLE table=default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.631623 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958ced04a94b47aebff1f92b0f32ccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.619179 3134 tablet_service.cc:1558] Processing DeleteTablet for tablet 005e9901c235496cacef80d431b60cc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 057be33fa10b4480b69af12f3800ce80) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:24.642833 3545 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.646816 3545 tablet_bootstrap.cc:654] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.652988 3466 consensus_queue.cc:1048] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.656737 3545 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.657593 3545 ts_tablet_manager.cc:1403] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20260924 02:04:24.660360 3545 raft_consensus.cc:359] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.661226 3545 raft_consensus.cc:385] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.661624 3545 raft_consensus.cc:740] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.662380 3545 consensus_queue.cc:260] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.663652 3545 ts_tablet_manager.cc:1434] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260924 02:04:24.664713 3545 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.667641 3545 tablet_bootstrap.cc:654] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.674697 3540 tablet_replica.cc:333] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:24.674997 3540 raft_consensus.cc:2243] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.676113 3540 raft_consensus.cc:2272] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.676774 3540 ts_tablet_manager.cc:1916] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.679533 3543 tablet_replica.cc:333] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:24.680160 3543 raft_consensus.cc:2243] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:24.680998 3543 pending_rounds.cc:70] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Trying to abort 1 pending ops.
I20260924 02:04:24.679862 3545 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.681181 3543 pending_rounds.cc:77] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332722539539079168 op_type: NO_OP noop_request { }
I20260924 02:04:24.681514 3545 ts_tablet_manager.cc:1403] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.006s
I20260924 02:04:24.682050 3542 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:24.682893 3545 raft_consensus.cc:359] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.683173 3545 raft_consensus.cc:385] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.683276 3545 raft_consensus.cc:740] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.681540 3543 raft_consensus.cc:2889] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260924 02:04:24.683629 3543 raft_consensus.cc:2272] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.684551 3543 ts_tablet_manager.cc:1916] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.685887 3542 tablet_bootstrap.cc:654] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.685791 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (DEFAULT_TABLE table=default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.686302 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca399002f6a489cbdddbbec7b0cc4a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.687373 3541 tablet_replica.cc:333] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:24.687649 3541 raft_consensus.cc:2243] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.687942 3541 raft_consensus.cc:2272] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.688649 3541 ts_tablet_manager.cc:1916] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.692298 3537 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:24.697841 2753 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 62ac1b1e60184f1095090619805dda03
I20260924 02:04:24.698997 2998 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac1b1e60184f1095090619805dda03 with delete_type TABLET_DATA_DELETED (replaced by tablet 42853fb879f54da281cd265b23129631) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:24.699816 2753 catalog_manager.cc:6934] ReplaceTablet: tablet 62ac1b1e60184f1095090619805dda03 deleted and replaced by tablet 42853fb879f54da281cd265b23129631
I20260924 02:04:24.699973 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac1b1e60184f1095090619805dda03 with delete_type TABLET_DATA_DELETED (replaced by tablet 42853fb879f54da281cd265b23129631) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:24.700083 2753 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52768 (request call id 29) took 1470 ms. Trace:
I20260924 02:04:24.700214 2753 rpcz_store.cc:276] 0924 02:04:23.229433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.621914 (+1392481us) service_pool.cc:224] Handling call
0924 02:04:24.700026 (+ 78112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.681466 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.681650 (+ 184us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.681659 (+ 9us) write_op.cc:435] Acquired schema lock
0924 02:04:24.681663 (+ 4us) tablet.cc:662] Decoding operations
0924 02:04:24.681811 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.681829 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.681834 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.681931 (+ 97us) tablet.cc:701] Row locks acquired
0924 02:04:24.681933 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:24.681984 (+ 51us) write_op.cc:270] Start()
0924 02:04:24.682029 (+ 45us) write_op.cc:276] Timestamp: P: 1790215464681963 usec, L: 0
0924 02:04:24.682035 (+ 6us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.682321 (+ 286us) log.cc:844] Serialized 658 byte log entry
0924 02:04:24.695866 (+ 13545us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.696758 (+ 892us) write_op.cc:301] APPLY: starting
0924 02:04:24.696780 (+ 22us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.696842 (+ 62us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.696867 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.696987 (+ 120us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.697051 (+ 64us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:24.697059 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:24.697166 (+ 107us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.697251 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.697279 (+ 28us) write_op.cc:454] Released schema lock
0924 02:04:24.697287 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":815,"apply.run_cpu_time_us":735,"apply.run_wall_time_us":734,"num_ops":2,"prepare.queue_time_us":58132,"raft.queue_time_us":9468,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":459,"replication_time_us":13777}]]}
I20260924 02:04:24.704002 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet 62ac1b1e60184f1095090619805dda03 with delete_type TABLET_DATA_DELETED (replaced by tablet 42853fb879f54da281cd265b23129631) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:24.705389 3545 consensus_queue.cc:260] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.707180 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (DEFAULT_TABLE table=default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.707764 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca399002f6a489cbdddbbec7b0cc4a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.710131 3545 ts_tablet_manager.cc:1434] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260924 02:04:24.715826 3545 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.718132 3540 ts_tablet_manager.cc:1929] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:24.718297 3545 tablet_bootstrap.cc:654] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.719153 3537 tablet_bootstrap.cc:654] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.719491 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (DEFAULT_TABLE table=default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.721602 3540 log.cc:1199] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/8fb06864c6e94123a800742968dfbc49
I20260924 02:04:24.722683 3540 ts_tablet_manager.cc:1950] T 8fb06864c6e94123a800742968dfbc49 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:24.724532 3543 ts_tablet_manager.cc:1929] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.724865 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 8fb06864c6e94123a800742968dfbc49 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:24.727748 3540 tablet_replica.cc:333] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:24.728343 3540 raft_consensus.cc:2243] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:24.729399 3540 raft_consensus.cc:2272] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.729590 3543 log.cc:1199] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/8fb06864c6e94123a800742968dfbc49
I20260924 02:04:24.730381 3543 ts_tablet_manager.cc:1950] T 8fb06864c6e94123a800742968dfbc49 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:24.731501 3540 ts_tablet_manager.cc:1916] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.733443 3466 raft_consensus.cc:493] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:24.733556 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 8fb06864c6e94123a800742968dfbc49 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:24.733649 3466 raft_consensus.cc:515] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.734423 3466 leader_election.cc:290] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:24.734799 2748 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5
I20260924 02:04:24.735445 2748 catalog_manager.cc:6934] ReplaceTablet: tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 deleted and replaced by tablet 711a7b2e55214fd0a7849d997ebfcf92
I20260924 02:04:24.735592 2748 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52768 (request call id 30) took 1505 ms. Trace:
I20260924 02:04:24.735534 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:24.735682 2748 rpcz_store.cc:276] 0924 02:04:23.230037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.622839 (+1392802us) service_pool.cc:224] Handling call
0924 02:04:24.735530 (+112691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.708269 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.708396 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.708401 (+ 5us) write_op.cc:435] Acquired schema lock
0924 02:04:24.708403 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.708524 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.708542 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.708548 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.708644 (+ 96us) tablet.cc:701] Row locks acquired
0924 02:04:24.708646 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:24.708687 (+ 41us) write_op.cc:270] Start()
0924 02:04:24.708724 (+ 37us) write_op.cc:276] Timestamp: P: 1790215464708669 usec, L: 0
0924 02:04:24.708728 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.708950 (+ 222us) log.cc:844] Serialized 658 byte log entry
0924 02:04:24.732615 (+ 23665us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.733817 (+ 1202us) write_op.cc:301] APPLY: starting
0924 02:04:24.733842 (+ 25us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.733890 (+ 48us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.733961 (+ 71us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.734096 (+ 135us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.734166 (+ 70us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:24.734174 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:24.734283 (+ 109us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.734378 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.734404 (+ 26us) write_op.cc:454] Released schema lock
0924 02:04:24.734412 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:24.734496 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.734500 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1114,"apply.run_cpu_time_us":677,"apply.run_wall_time_us":677,"mutex_wait_us":57276,"num_ops":2,"prepare.queue_time_us":84099,"prepare.run_cpu_time_us":896,"prepare.run_wall_time_us":12846,"raft.queue_time_us":8131,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":310,"replication_time_us":23826}]]}
W20260924 02:04:24.736470 3090 leader_election.cc:343] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:24.729219 3545 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.736837 3545 ts_tablet_manager.cc:1403] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260924 02:04:24.737694 3545 raft_consensus.cc:359] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.737915 3545 raft_consensus.cc:385] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.738005 3545 raft_consensus.cc:740] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.739107 3543 tablet_replica.cc:333] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:24.739529 3543 raft_consensus.cc:2243] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.740559 2998 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 711a7b2e55214fd0a7849d997ebfcf92) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:24.741154 3543 raft_consensus.cc:2272] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.739995 3545 consensus_queue.cc:260] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.742295 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 711a7b2e55214fd0a7849d997ebfcf92) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:24.746639 3545 ts_tablet_manager.cc:1434] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260924 02:04:24.748031 3543 ts_tablet_manager.cc:1916] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.749334 3466 raft_consensus.cc:493] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:24.751196 3466 raft_consensus.cc:515] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.751943 3466 leader_election.cc:290] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:24.753114 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca399002f6a489cbdddbbec7b0cc4a7" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
W20260924 02:04:24.753816 3090 leader_election.cc:343] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:24.758996 2748 master_service.cc:960] ReplaceTablet: received request to replace tablet 17a6b94a735f453cbc7920435aa0ad28 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:24.760176 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 42853fb879f54da281cd265b23129631 (DEFAULT_TABLE table=default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.760300 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 42853fb879f54da281cd265b23129631 (DEFAULT_TABLE table=default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.760831 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42853fb879f54da281cd265b23129631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.760887 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42853fb879f54da281cd265b23129631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.766072 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 057be33fa10b4480b69af12f3800ce80 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.766605 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057be33fa10b4480b69af12f3800ce80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.778278 3543 ts_tablet_manager.cc:1929] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.778573 3543 log.cc:1199] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/005e9901c235496cacef80d431b60cc2
I20260924 02:04:24.779415 3545 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.781829 3540 ts_tablet_manager.cc:1929] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.782719 3545 tablet_bootstrap.cc:654] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.786274 2748 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 17a6b94a735f453cbc7920435aa0ad28
I20260924 02:04:24.787549 2748 catalog_manager.cc:6934] ReplaceTablet: tablet 17a6b94a735f453cbc7920435aa0ad28 deleted and replaced by tablet 8654b43c40cb4c328ea519d645b9447e
I20260924 02:04:24.787701 2748 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52768 (request call id 31) took 1522 ms. Trace:
I20260924 02:04:24.787833 2748 rpcz_store.cc:276] 0924 02:04:23.265270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.758811 (+1493541us) service_pool.cc:224] Handling call
0924 02:04:24.787666 (+ 28855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:24.762691 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:24.762831 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:24.762837 (+ 6us) write_op.cc:435] Acquired schema lock
0924 02:04:24.762839 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:24.763051 (+ 212us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:24.763067 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:24.763072 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:24.763167 (+ 95us) tablet.cc:701] Row locks acquired
0924 02:04:24.763169 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:24.763211 (+ 42us) write_op.cc:270] Start()
0924 02:04:24.763250 (+ 39us) write_op.cc:276] Timestamp: P: 1790215464763189 usec, L: 0
0924 02:04:24.763253 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:24.763492 (+ 239us) log.cc:844] Serialized 658 byte log entry
0924 02:04:24.784126 (+ 20634us) op_driver.cc:464] REPLICATION: finished
0924 02:04:24.785205 (+ 1079us) write_op.cc:301] APPLY: starting
0924 02:04:24.785231 (+ 26us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:24.785294 (+ 63us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:24.785330 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:24.785628 (+ 298us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:24.785704 (+ 76us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:24.785712 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:24.785835 (+ 123us) log.cc:844] Serialized 28 byte log entry
0924 02:04:24.785919 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:24.785948 (+ 29us) write_op.cc:454] Released schema lock
0924 02:04:24.785958 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":995,"mutex_wait_us":5944,"num_ops":2,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":1077,"prepare.run_wall_time_us":18177,"raft.queue_time_us":6092,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":804,"replication_time_us":20817}]]}
I20260924 02:04:24.788570 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 42853fb879f54da281cd265b23129631 (DEFAULT_TABLE table=default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.788656 2748 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_784a6bfac1a7463294326833a9ec4c8a" } modify_external_catalogs: true
I20260924 02:04:24.788944 2748 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_784a6bfac1a7463294326833a9ec4c8a" } modify_external_catalogs: true
I20260924 02:04:24.789075 3276 tablet_service.cc:1558] Processing DeleteTablet for tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 711a7b2e55214fd0a7849d997ebfcf92) from {username='slave'} at 127.0.0.1:54378
W20260924 02:04:24.790323 3092 leader_election.cc:343] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Not found: Tablet not found: 0ca399002f6a489cbdddbbec7b0cc4a7
I20260924 02:04:24.790324 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 with delete_type TABLET_DATA_DELETED (replaced by tablet 8654b43c40cb4c328ea519d645b9447e) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:24.790584 3092 leader_election.cc:304] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3d5f64871b3487b9705befe2938e289; no voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:24.791010 3466 raft_consensus.cc:2749] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260924 02:04:24.791326 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca399002f6a489cbdddbbec7b0cc4a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.791903 3543 ts_tablet_manager.cc:1950] T 005e9901c235496cacef80d431b60cc2 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:24.792735 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42853fb879f54da281cd265b23129631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.793516 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 005e9901c235496cacef80d431b60cc2 (table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]) successfully deleted
I20260924 02:04:24.795331 3543 tablet_replica.cc:333] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:24.796209 3543 raft_consensus.cc:2243] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.796518 3543 raft_consensus.cc:2272] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.797178 3276 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 with delete_type TABLET_DATA_DELETED (replaced by tablet 8654b43c40cb4c328ea519d645b9447e) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:24.785832 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
W20260924 02:04:24.798633 3092 leader_election.cc:343] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:24.798838 3092 leader_election.cc:304] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3d5f64871b3487b9705befe2938e289; no voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:24.799229 3466 raft_consensus.cc:2749] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260924 02:04:24.801388 2753 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_da49dc787bc94e6f99faf522e45a9529"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:24.802630 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 057be33fa10b4480b69af12f3800ce80 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.803295 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057be33fa10b4480b69af12f3800ce80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.803602 3276 tablet_service.cc:1511] Processing CreateTablet for tablet 057be33fa10b4480b69af12f3800ce80 (DEFAULT_TABLE table=default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.804528 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057be33fa10b4480b69af12f3800ce80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.787782 3454 consensus_queue.cc:1048] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.815317 3540 log.cc:1199] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/005e9901c235496cacef80d431b60cc2
I20260924 02:04:24.816998 3540 ts_tablet_manager.cc:1950] T 005e9901c235496cacef80d431b60cc2 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:24.822100 3454 consensus_queue.cc:1048] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.822791 3543 ts_tablet_manager.cc:1916] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.827884 3540 tablet_replica.cc:333] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:24.828369 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 005e9901c235496cacef80d431b60cc2 (table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]) successfully deleted
I20260924 02:04:24.828907 3540 raft_consensus.cc:2243] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:24.829340 3540 raft_consensus.cc:2272] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.830924 3543 ts_tablet_manager.cc:1929] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:24.831107 3543 log.cc:1199] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/62ac1b1e60184f1095090619805dda03
I20260924 02:04:24.831552 3543 ts_tablet_manager.cc:1950] T 62ac1b1e60184f1095090619805dda03 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:24.832675 3543 tablet_replica.cc:333] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:24.832904 3543 raft_consensus.cc:2243] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:24.833438 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:24.834095 3494 consensus_queue.cc:1048] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.834654 3543 raft_consensus.cc:2272] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.838267 3540 ts_tablet_manager.cc:1916] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.794524 2998 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a6b94a735f453cbc7920435aa0ad28 with delete_type TABLET_DATA_DELETED (replaced by tablet 8654b43c40cb4c328ea519d645b9447e) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:24.800118 3495 consensus_queue.cc:1048] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.798633 3545 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.839823 3545 ts_tablet_manager.cc:1403] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.007s
I20260924 02:04:24.840932 3545 raft_consensus.cc:359] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.841264 3545 raft_consensus.cc:385] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.841382 3545 raft_consensus.cc:740] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.841727 3545 consensus_queue.cc:260] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.842248 3495 consensus_queue.cc:1048] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.852946 3545 ts_tablet_manager.cc:1434] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260924 02:04:24.853431 3545 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.855831 3545 tablet_bootstrap.cc:654] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.850831 3543 ts_tablet_manager.cc:1916] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.859270 3537 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:24.859681 3537 ts_tablet_manager.cc:1403] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.168s user 0.012s sys 0.003s
I20260924 02:04:24.860692 3537 raft_consensus.cc:359] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.862640 3537 raft_consensus.cc:385] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.863098 3537 raft_consensus.cc:740] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.865625 3541 ts_tablet_manager.cc:1929] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260924 02:04:24.865792 3541 log.cc:1199] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/8fb06864c6e94123a800742968dfbc49
I20260924 02:04:24.866207 3541 ts_tablet_manager.cc:1950] T 8fb06864c6e94123a800742968dfbc49 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:24.815042 3542 tablet_bootstrap.cc:492] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:24.868285 3542 ts_tablet_manager.cc:1403] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.186s user 0.014s sys 0.009s
I20260924 02:04:24.869436 3542 raft_consensus.cc:359] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.869696 3542 raft_consensus.cc:385] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.869855 3542 raft_consensus.cc:740] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.871733 3541 tablet_replica.cc:333] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:24.872133 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 8fb06864c6e94123a800742968dfbc49 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]) successfully deleted
I20260924 02:04:24.872582 3541 raft_consensus.cc:2243] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.875043 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.875778 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711a7b2e55214fd0a7849d997ebfcf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.877410 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.877372 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 (DEFAULT_TABLE table=default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.878101 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711a7b2e55214fd0a7849d997ebfcf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.875677 3541 raft_consensus.cc:2272] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.878584 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711a7b2e55214fd0a7849d997ebfcf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.884609 3542 consensus_queue.cc:260] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.885353 3542 ts_tablet_manager.cc:1434] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260924 02:04:24.886730 3541 ts_tablet_manager.cc:1916] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.888208 3542 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:24.864101 3537 consensus_queue.cc:260] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.890651 3543 ts_tablet_manager.cc:1929] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.890820 3543 log.cc:1199] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/93c4bdf7a5cf4e5b84ac7dbd0e03c0b5
I20260924 02:04:24.891409 3543 ts_tablet_manager.cc:1950] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:24.892874 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:24.894408 3545 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.894613 3545 ts_tablet_manager.cc:1403] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.000s
I20260924 02:04:24.895085 3495 consensus_queue.cc:1048] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.896049 3537 ts_tablet_manager.cc:1434] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260924 02:04:24.899552 3537 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:24.903486 2749 catalog_manager.cc:3541] renamed table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4] in HMS: new name default.table_635d6d13e9ef48aca3c221ede242342e
I20260924 02:04:24.903553 3545 raft_consensus.cc:359] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.904867 3545 raft_consensus.cc:385] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.904985 3545 raft_consensus.cc:740] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.905983 3545 consensus_queue.cc:260] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.908728 3545 ts_tablet_manager.cc:1434] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.014s user 0.002s sys 0.003s
I20260924 02:04:24.909804 2998 tablet_service.cc:1511] Processing CreateTablet for tablet 8654b43c40cb4c328ea519d645b9447e (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.910257 3276 tablet_service.cc:1511] Processing CreateTablet for tablet 8654b43c40cb4c328ea519d645b9447e (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.910368 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8654b43c40cb4c328ea519d645b9447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.910683 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 8654b43c40cb4c328ea519d645b9447e (DEFAULT_TABLE table=default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:24.911276 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8654b43c40cb4c328ea519d645b9447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.911621 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8654b43c40cb4c328ea519d645b9447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:24.915723 3543 tablet_replica.cc:333] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:24.916204 3543 raft_consensus.cc:2243] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:24.916755 3543 raft_consensus.cc:2272] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.917126 3545 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.919107 3545 tablet_bootstrap.cc:654] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.921352 3542 tablet_bootstrap.cc:654] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.926095 3540 ts_tablet_manager.cc:1929] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:24.926250 3540 log.cc:1199] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/62ac1b1e60184f1095090619805dda03
I20260924 02:04:24.926772 3540 ts_tablet_manager.cc:1950] T 62ac1b1e60184f1095090619805dda03 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:24.931825 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:24.932651 3540 tablet_replica.cc:333] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:24.933634 3540 raft_consensus.cc:2243] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.933990 3543 ts_tablet_manager.cc:1916] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.934808 3540 raft_consensus.cc:2272] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.938776 3540 ts_tablet_manager.cc:1916] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.943991 3537 tablet_bootstrap.cc:654] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.950317 3541 ts_tablet_manager.cc:1929] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.950515 3541 log.cc:1199] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/005e9901c235496cacef80d431b60cc2
I20260924 02:04:24.951004 3541 ts_tablet_manager.cc:1950] T 005e9901c235496cacef80d431b60cc2 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:24.951987 3543 ts_tablet_manager.cc:1929] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:24.952121 3541 tablet_replica.cc:333] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:24.952324 3541 raft_consensus.cc:2243] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:24.952268 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 005e9901c235496cacef80d431b60cc2 (table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]) successfully deleted
I20260924 02:04:24.952668 3541 raft_consensus.cc:2272] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:24.954382 3541 ts_tablet_manager.cc:1916] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:24.954692 3543 log.cc:1199] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/17a6b94a735f453cbc7920435aa0ad28
I20260924 02:04:24.955291 3543 ts_tablet_manager.cc:1950] T 17a6b94a735f453cbc7920435aa0ad28 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:24.955695 3537 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:24.956310 2741 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 17a6b94a735f453cbc7920435aa0ad28 (table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]) successfully deleted
I20260924 02:04:24.964033 3542 tablet_bootstrap.cc:492] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:24.968166 3545 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.968166 3537 ts_tablet_manager.cc:1403] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.000s
I20260924 02:04:24.968365 3545 ts_tablet_manager.cc:1403] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.007s
I20260924 02:04:24.968652 3542 ts_tablet_manager.cc:1403] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.081s user 0.007s sys 0.001s
I20260924 02:04:24.969054 3537 raft_consensus.cc:359] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.969105 3545 raft_consensus.cc:359] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.969305 3545 raft_consensus.cc:385] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.969375 3545 raft_consensus.cc:740] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.969635 3545 consensus_queue.cc:260] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.969686 3542 raft_consensus.cc:359] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.970034 3542 raft_consensus.cc:385] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.970074 3537 raft_consensus.cc:385] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.970185 3545 ts_tablet_manager.cc:1434] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260924 02:04:24.970176 3542 raft_consensus.cc:740] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.970769 3542 consensus_queue.cc:260] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.972522 3545 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:24.971361 3542 ts_tablet_manager.cc:1434] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260924 02:04:24.974229 3542 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:24.975500 3545 tablet_bootstrap.cc:654] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:24.978008 3466 consensus_queue.cc:1048] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:24.970314 3537 raft_consensus.cc:740] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.980755 3537 consensus_queue.cc:260] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.983487 3537 ts_tablet_manager.cc:1434] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260924 02:04:24.985270 3537 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:24.986332 3428 raft_consensus.cc:493] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:24.986505 3428 raft_consensus.cc:515] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.987314 3428 leader_election.cc:290] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:24.989229 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9c9a9031cb48c3a7844134859b347b" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:24.989569 3017 raft_consensus.cc:2468] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:24.990428 3229 leader_election.cc:304] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:24.991130 3428 raft_consensus.cc:2804] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:24.991309 3428 raft_consensus.cc:493] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:24.991421 3428 raft_consensus.cc:3060] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:24.991968 3545 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:24.992161 3545 ts_tablet_manager.cc:1403] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260924 02:04:24.993260 3545 raft_consensus.cc:359] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.993479 3545 raft_consensus.cc:385] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:24.993579 3545 raft_consensus.cc:740] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:24.993927 3545 consensus_queue.cc:260] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:24.997097 3545 ts_tablet_manager.cc:1434] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260924 02:04:25.002981 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9c9a9031cb48c3a7844134859b347b" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:25.003324 3156 raft_consensus.cc:2468] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:25.006983 3428 raft_consensus.cc:515] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.008006 3428 leader_election.cc:290] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:25.010205 3540 ts_tablet_manager.cc:1929] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:25.010409 3540 log.cc:1199] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/93c4bdf7a5cf4e5b84ac7dbd0e03c0b5
I20260924 02:04:25.010645 3537 tablet_bootstrap.cc:654] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.012626 3542 tablet_bootstrap.cc:654] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.012868 3466 consensus_queue.cc:1048] T a0402fd077bb4f169f9af62a255d79fe P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.016266 3540 ts_tablet_manager.cc:1950] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:25.017629 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:25.018115 3540 tablet_replica.cc:333] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:25.018337 3540 raft_consensus.cc:2243] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:25.018575 3540 raft_consensus.cc:2272] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:25.019408 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9c9a9031cb48c3a7844134859b347b" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:25.019634 3018 raft_consensus.cc:3060] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.021231 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc9c9a9031cb48c3a7844134859b347b" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:25.021559 3156 raft_consensus.cc:3060] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.024233 3018 raft_consensus.cc:2468] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:25.025941 3229 leader_election.cc:304] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.026473 3428 raft_consensus.cc:2804] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.033948 3156 raft_consensus.cc:2468] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:25.036888 3541 ts_tablet_manager.cc:1929] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:25.045101 3542 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:25.045310 3542 ts_tablet_manager.cc:1403] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.071s user 0.001s sys 0.003s
I20260924 02:04:25.046176 3542 raft_consensus.cc:359] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.046428 3542 raft_consensus.cc:385] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.046526 3542 raft_consensus.cc:740] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.046830 3542 consensus_queue.cc:260] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.048561 3540 ts_tablet_manager.cc:1916] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:25.048869 3541 log.cc:1199] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/62ac1b1e60184f1095090619805dda03
I20260924 02:04:25.037968 3428 raft_consensus.cc:697] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Becoming Leader. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Running, Role: LEADER
I20260924 02:04:25.042841 3537 tablet_bootstrap.cc:492] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:25.049549 3537 ts_tablet_manager.cc:1403] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.064s user 0.022s sys 0.008s
I20260924 02:04:25.050527 3428 consensus_queue.cc:237] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.051240 3537 raft_consensus.cc:359] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.051474 3537 raft_consensus.cc:385] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.051574 3537 raft_consensus.cc:740] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.051931 3537 consensus_queue.cc:260] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.053140 3537 ts_tablet_manager.cc:1434] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 02:04:25.053531 3537 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:25.056753 3537 tablet_bootstrap.cc:654] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.058354 3542 ts_tablet_manager.cc:1434] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260924 02:04:25.058739 3540 ts_tablet_manager.cc:1929] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:25.058920 3540 log.cc:1199] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/17a6b94a735f453cbc7920435aa0ad28
I20260924 02:04:25.059201 3542 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:25.059463 3540 ts_tablet_manager.cc:1950] T 17a6b94a735f453cbc7920435aa0ad28 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:25.061009 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 17a6b94a735f453cbc7920435aa0ad28 (table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]) successfully deleted
I20260924 02:04:25.061424 3541 ts_tablet_manager.cc:1950] T 62ac1b1e60184f1095090619805dda03 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:25.061887 3542 tablet_bootstrap.cc:654] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.062739 3541 tablet_replica.cc:333] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:25.063004 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 62ac1b1e60184f1095090619805dda03 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]) successfully deleted
I20260924 02:04:25.063282 3541 raft_consensus.cc:2243] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:25.063540 3541 raft_consensus.cc:2272] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:25.072959 3537 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:25.073267 3537 ts_tablet_manager.cc:1403] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.004s
I20260924 02:04:25.077831 3537 raft_consensus.cc:359] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.078111 3537 raft_consensus.cc:385] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.078207 3537 raft_consensus.cc:740] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.078567 3537 consensus_queue.cc:260] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.083241 3537 ts_tablet_manager.cc:1434] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.010s user 0.003s sys 0.001s
I20260924 02:04:25.084996 3541 ts_tablet_manager.cc:1916] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:25.093722 3537 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:25.098443 3537 tablet_bootstrap.cc:654] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.101243 3542 tablet_bootstrap.cc:492] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:25.102206 3542 ts_tablet_manager.cc:1403] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.000s
I20260924 02:04:25.103223 3542 raft_consensus.cc:359] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.103513 3542 raft_consensus.cc:385] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.103650 3542 raft_consensus.cc:740] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.121717 3428 raft_consensus.cc:493] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.122033 3428 raft_consensus.cc:515] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.123023 3428 leader_election.cc:290] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:25.123332 3542 consensus_queue.cc:260] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.123989 3542 ts_tablet_manager.cc:1434] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260924 02:04:25.124879 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca399002f6a489cbdddbbec7b0cc4a7" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:25.124917 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca399002f6a489cbdddbbec7b0cc4a7" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:25.125142 3017 raft_consensus.cc:2468] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:25.125144 3156 raft_consensus.cc:2468] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:25.125247 3537 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:25.125411 3537 ts_tablet_manager.cc:1403] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260924 02:04:25.125883 3230 leader_election.cc:304] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:25.126216 3537 raft_consensus.cc:359] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.126415 3537 raft_consensus.cc:385] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.126503 3428 raft_consensus.cc:2804] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.126595 3428 raft_consensus.cc:493] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.126703 3428 raft_consensus.cc:3060] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.127722 3542 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:25.130002 3542 tablet_bootstrap.cc:654] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.129900 3428 raft_consensus.cc:515] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.131271 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca399002f6a489cbdddbbec7b0cc4a7" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:25.131520 3017 raft_consensus.cc:3060] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.134703 3017 raft_consensus.cc:2468] T 0ca399002f6a489cbdddbbec7b0cc4a7 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:25.134974 3541 ts_tablet_manager.cc:1929] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:25.135160 3541 log.cc:1199] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/93c4bdf7a5cf4e5b84ac7dbd0e03c0b5
I20260924 02:04:25.135447 3229 leader_election.cc:304] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.135577 3541 ts_tablet_manager.cc:1950] T 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:25.135900 3596 raft_consensus.cc:2804] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.136610 3541 tablet_replica.cc:333] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:25.136801 3541 raft_consensus.cc:2243] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:25.136830 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 93c4bdf7a5cf4e5b84ac7dbd0e03c0b5 (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:25.136979 3541 raft_consensus.cc:2272] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:25.138888 3541 ts_tablet_manager.cc:1916] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:25.139931 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca399002f6a489cbdddbbec7b0cc4a7" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:25.140157 3156 raft_consensus.cc:3060] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.140264 3596 raft_consensus.cc:697] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Becoming Leader. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Running, Role: LEADER
I20260924 02:04:25.140656 3596 consensus_queue.cc:237] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.142092 3428 leader_election.cc:290] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:25.143422 3156 raft_consensus.cc:2468] T 0ca399002f6a489cbdddbbec7b0cc4a7 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:25.145432 3537 raft_consensus.cc:740] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.145797 3537 consensus_queue.cc:260] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.147292 3537 ts_tablet_manager.cc:1434] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260924 02:04:25.147651 3537 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:25.149869 3542 tablet_bootstrap.cc:492] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:25.150051 3542 ts_tablet_manager.cc:1403] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260924 02:04:25.150918 3537 tablet_bootstrap.cc:654] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.151024 3542 raft_consensus.cc:359] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.151234 3542 raft_consensus.cc:385] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.151335 3542 raft_consensus.cc:740] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.151618 3542 consensus_queue.cc:260] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.153934 3569 consensus_queue.cc:1048] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.156617 3542 ts_tablet_manager.cc:1434] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260924 02:04:25.162027 3542 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:25.164738 3542 tablet_bootstrap.cc:654] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.169826 3541 ts_tablet_manager.cc:1929] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:25.169988 3541 log.cc:1199] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/17a6b94a735f453cbc7920435aa0ad28
I20260924 02:04:25.170487 3541 ts_tablet_manager.cc:1950] T 17a6b94a735f453cbc7920435aa0ad28 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:25.173779 3494 consensus_queue.cc:1048] T 6257a7b0828648b690113c2ad78260ad P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.174383 3621 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.254:45523 every 8 connection(s)
I20260924 02:04:25.176043 3419 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.254:45523
I20260924 02:04:25.178574 3419 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
I20260924 02:04:25.182224 3537 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:25.182432 3537 ts_tablet_manager.cc:1403] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.012s
I20260924 02:04:25.183877 3542 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:25.184202 3542 ts_tablet_manager.cc:1403] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260924 02:04:25.184831 3537 raft_consensus.cc:359] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.185073 3537 raft_consensus.cc:385] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.185153 3537 raft_consensus.cc:740] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.186640 3537 consensus_queue.cc:260] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.187263 3542 raft_consensus.cc:359] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.188767 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 3419
I20260924 02:04:25.194597 3542 raft_consensus.cc:385] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.194875 3542 raft_consensus.cc:740] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.195454 3542 consensus_queue.cc:260] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.196283 3542 ts_tablet_manager.cc:1434] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260924 02:04:25.196732 3542 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:25.198768 3542 tablet_bootstrap.cc:654] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.200268 3537 ts_tablet_manager.cc:1434] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.018s user 0.002s sys 0.001s
I20260924 02:04:25.200788 3537 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:25.212103 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 17a6b94a735f453cbc7920435aa0ad28 (table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]) successfully deleted
I20260924 02:04:25.234175 3542 tablet_bootstrap.cc:492] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:25.234478 3542 ts_tablet_manager.cc:1403] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.038s user 0.024s sys 0.010s
I20260924 02:04:25.235437 3542 raft_consensus.cc:359] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.235774 3542 raft_consensus.cc:385] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.235955 3542 raft_consensus.cc:740] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.236320 3542 consensus_queue.cc:260] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.236433 3537 tablet_bootstrap.cc:654] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:25.240367 3542 ts_tablet_manager.cc:1434] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260924 02:04:25.245155 3537 tablet_bootstrap.cc:492] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:25.245445 3537 ts_tablet_manager.cc:1403] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260924 02:04:25.246430 3537 raft_consensus.cc:359] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.246735 3537 raft_consensus.cc:385] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:25.246904 3537 raft_consensus.cc:740] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.247242 3537 consensus_queue.cc:260] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.247912 3537 ts_tablet_manager.cc:1434] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260924 02:04:25.266254 3624 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:25.276636 3494 raft_consensus.cc:493] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.276872 3494 raft_consensus.cc:515] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.277632 3494 leader_election.cc:290] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.278637 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711a7b2e55214fd0a7849d997ebfcf92" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:25.278878 3296 raft_consensus.cc:2468] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:25.279923 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711a7b2e55214fd0a7849d997ebfcf92" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:25.280160 3156 raft_consensus.cc:2468] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:25.280953 2953 leader_election.cc:304] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.281713 3494 raft_consensus.cc:2804] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.281821 3494 raft_consensus.cc:493] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.281912 3494 raft_consensus.cc:3060] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.285590 3494 raft_consensus.cc:515] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.287073 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711a7b2e55214fd0a7849d997ebfcf92" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:25.287348 3156 raft_consensus.cc:3060] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.290305 3494 leader_election.cc:290] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.291061 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711a7b2e55214fd0a7849d997ebfcf92" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:25.291276 3296 raft_consensus.cc:3060] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.292516 3156 raft_consensus.cc:2468] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:25.293278 2952 leader_election.cc:304] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.293715 3494 raft_consensus.cc:2804] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.293931 3494 raft_consensus.cc:697] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:25.294260 3494 consensus_queue.cc:237] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.294600 3296 raft_consensus.cc:2468] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:25.295176 3342 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:25.306205 3064 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:25.308156 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap starting.
I20260924 02:04:25.309866 3203 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:25.318708 2751 catalog_manager.cc:3541] renamed table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93] in HMS: new name default.table_4fd30425787341509cfacfe3c2b7ad27
I20260924 02:04:25.321154 3203 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:25.322389 3464 raft_consensus.cc:493] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.322571 3464 raft_consensus.cc:515] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.323366 3464 leader_election.cc:290] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.324371 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8654b43c40cb4c328ea519d645b9447e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:25.324647 3017 raft_consensus.cc:2468] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.325098 3090 leader_election.cc:304] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.325461 3464 raft_consensus.cc:2804] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.325562 3464 raft_consensus.cc:493] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.325536 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8654b43c40cb4c328ea519d645b9447e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:25.325657 3464 raft_consensus.cc:3060] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.325809 3296 raft_consensus.cc:2468] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.328938 3464 raft_consensus.cc:515] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.330629 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8654b43c40cb4c328ea519d645b9447e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:25.330905 3017 raft_consensus.cc:3060] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.335615 3017 raft_consensus.cc:2468] T 8654b43c40cb4c328ea519d645b9447e P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.336552 3090 leader_election.cc:304] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.337039 3590 raft_consensus.cc:2804] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.337200 3590 raft_consensus.cc:697] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:25.337598 3590 consensus_queue.cc:237] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.339108 3466 raft_consensus.cc:493] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.339394 3466 raft_consensus.cc:515] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.340157 3466 leader_election.cc:290] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.341472 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057be33fa10b4480b69af12f3800ce80" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:25.341763 3296 raft_consensus.cc:2468] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.342295 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057be33fa10b4480b69af12f3800ce80" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:25.342545 3018 raft_consensus.cc:2468] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.343266 3092 leader_election.cc:304] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:25.344360 3466 raft_consensus.cc:2804] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.344491 3466 raft_consensus.cc:493] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.345703 3466 raft_consensus.cc:3060] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.348891 3466 raft_consensus.cc:515] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.354398 3624 log.cc:826] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:25.354988 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8654b43c40cb4c328ea519d645b9447e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:25.355291 3296 raft_consensus.cc:3060] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.359957 3296 raft_consensus.cc:2468] T 8654b43c40cb4c328ea519d645b9447e P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.360812 3464 leader_election.cc:290] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.361191 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057be33fa10b4480b69af12f3800ce80" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:25.363124 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057be33fa10b4480b69af12f3800ce80" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:25.363548 3296 raft_consensus.cc:3060] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.365765 3017 raft_consensus.cc:3060] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.366091 3466 leader_election.cc:290] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.369457 3296 raft_consensus.cc:2468] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.370298 3092 leader_election.cc:304] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:25.371083 3466 raft_consensus.cc:2804] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.371330 3466 raft_consensus.cc:697] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:25.373109 3466 consensus_queue.cc:237] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.377701 3017 raft_consensus.cc:2468] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.378384 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:25.380808 3624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap complete.
I20260924 02:04:25.384003 3634 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:25.384198 3634 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.384966 3634 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:25.386270 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:25.387665 3466 raft_consensus.cc:493] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.387856 3466 raft_consensus.cc:515] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.388588 3466 leader_election.cc:290] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.389371 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42853fb879f54da281cd265b23129631" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:25.389629 3017 raft_consensus.cc:2468] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.390585 3090 leader_election.cc:304] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.390910 3466 raft_consensus.cc:2804] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.391052 3466 raft_consensus.cc:493] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.391148 3466 raft_consensus.cc:3060] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.391553 3624 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.392764 3624 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b31e7e4c8ff4e30980f19a91551e618, State: Initialized, Role: FOLLOWER
I20260924 02:04:25.393700 3624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.394200 3466 raft_consensus.cc:515] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.394829 3637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.395242 3637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:25.395722 3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42853fb879f54da281cd265b23129631" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:25.395964 3017 raft_consensus.cc:3060] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.396304 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42853fb879f54da281cd265b23129631" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:25.396576 3296 raft_consensus.cc:2468] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:25.397084 3466 leader_election.cc:290] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.397306 3624 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:25.400538 3017 raft_consensus.cc:2468] T 42853fb879f54da281cd265b23129631 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.401113 3090 leader_election.cc:304] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.401542 3466 raft_consensus.cc:2804] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.401857 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42853fb879f54da281cd265b23129631" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:25.403121 3466 raft_consensus.cc:697] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:25.404465 3572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:25.405097 3572 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2629a26254094afb829bb3ca8fa2c593 in term 1.
I20260924 02:04:25.405812 3296 raft_consensus.cc:3060] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.405823 2814 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881
I20260924 02:04:25.406318 3634 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260924 02:04:25.406225 3466 consensus_queue.cc:237] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.406455 3634 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:25.406553 3634 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 1 FOLLOWER]: Advancing to term 2
I20260924 02:04:25.409647 3634 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.409785 3296 raft_consensus.cc:2468] T 42853fb879f54da281cd265b23129631 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:25.410995 3634 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:25.411280 3572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618"
I20260924 02:04:25.411523 3572 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 1 FOLLOWER]: Advancing to term 2
I20260924 02:04:25.413834 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881"
I20260924 02:04:25.419694 3572 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2629a26254094afb829bb3ca8fa2c593 in term 2.
I20260924 02:04:25.420925 2814 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881
I20260924 02:04:25.421692 3634 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 02:04:25.463099 3634 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 LEADER]: Becoming Leader. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Running, Role: LEADER
I20260924 02:04:25.463956 3634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.467898 3640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629a26254094afb829bb3ca8fa2c593. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.468262 3640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:25.469111 3645 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:25.473294 3645 catalog_manager.cc:692] Loaded metadata for table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:25.473995 3645 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:25.474455 3645 catalog_manager.cc:692] Loaded metadata for table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:25.474920 3645 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:25.483662 3645 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:25.484280 3645 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:25.484764 3645 catalog_manager.cc:692] Loaded metadata for table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:25.485280 3645 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:25.485755 3645 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:25.486231 3645 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:25.486697 3645 catalog_manager.cc:692] Loaded metadata for table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:25.487238 3645 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:25.490109 3645 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_70811bdb724048a99d02b5f3d7a6f6db [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:25.490557 3645 tablet_loader.cc:96] loaded metadata for tablet 0a0e19bdca93403c8bb502ba377fac75 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:25.490991 3645 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:25.491914 3645 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:25.492272 3645 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:25.492977 3645 tablet_loader.cc:96] loaded metadata for tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:25.493317 3645 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_db2d035430a54e0fb0680906d7f36ccd [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:25.494320 3645 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_9d13d6a0997c452789c83619b5e41dfe [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:25.494683 3645 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:25.495330 3645 tablet_loader.cc:96] loaded metadata for tablet d12d26db47694d7387bc01063f987fd6 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:25.495712 3645 tablet_loader.cc:96] loaded metadata for tablet dc9c9a9031cb48c3a7844134859b347b (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:25.496061 3645 tablet_loader.cc:96] loaded metadata for tablet e69bc9301d084222915283c63e3a4e9c (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:25.496368 3645 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:25.497795 3645 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:25.497889 3645 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:25.498349 2836 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 LEADER]: Rejecting Update request from peer 23f4e9ecc0904d0ba15506c5c2206881 for earlier term 1. Current term is 2. Ops: []
I20260924 02:04:25.499754 3645 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:25.499642 2907 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260924 02:04:25.501008 3645 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Loaded TSK: 0
I20260924 02:04:25.502159 3645 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:25.502283 2907 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Peer 2629a26254094afb829bb3ca8fa2c593 log is divergent from this leader: its last log entry 2.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260924 02:04:25.502436 3650 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 LEADER]: Stepping down as leader of term 1
I20260924 02:04:25.502524 3650 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Running, Role: LEADER
I20260924 02:04:25.503616 3650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:25.504226 3650 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 1 FOLLOWER]: Advancing to term 2
I20260924 02:04:25.515281 2747 catalog_manager.cc:3541] renamed table default.table_2aca678f0ea244b0be45a1b4c61b5a25 [id=ad901044a40b4a65b759e58912e9b84c] in HMS: new name default.table_2bbb2478ff414d04806f78dccbcabc8c
I20260924 02:04:25.516283 3645 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:25.518371 3645 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 11
I20260924 02:04:25.542448 3656 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 02:04:25.588361 2755 catalog_manager.cc:2213] created HMS catalog entry for table [id=0581ca27a28b4a588e3e0c18bf5b126d]
W20260924 02:04:25.589592 2755 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
I20260924 02:04:25.629740 2750 catalog_manager.cc:2213] created HMS catalog entry for table [id=961cf5019ff2456cb02f5fbdfb895264]
W20260924 02:04:25.630803 2750 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
I20260924 02:04:25.659205 2752 catalog_manager.cc:2213] created HMS catalog entry for table [id=c37207c1f21240d2a775eb44253222d1]
W20260924 02:04:25.660198 2752 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
W20260924 02:04:25.668524 2920 catalog_manager.cc:3978] Illegal state: an error occurred while updating the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
W20260924 02:04:25.668876 2920 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 12 ALTER_TABLE default.table_685250380f8543c9bbaeca23f7d90fef: Illegal state: an error occurred while updating the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
W20260924 02:04:25.669086 2920 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
I20260924 02:04:25.669389 2754 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 12) took 3130 ms. Trace:
I20260924 02:04:25.669533 2754 rpcz_store.cc:276] 0924 02:04:22.538616 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:22.540211 (+ 1595us) service_pool.cc:224] Handling call
0924 02:04:24.286489 (+1746278us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.669338 (+1382849us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":4706,"Hive Metastore.run_cpu_time_us":760,"Hive Metastore.run_wall_time_us":102261}
W20260924 02:04:25.670840 2754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.194:49687 (request call id 24) took 852 ms (client timeout 1000 ms). Trace:
W20260924 02:04:25.671141 2754 rpcz_store.cc:269] 0924 02:04:24.818308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.669966 (+851658us) service_pool.cc:224] Handling call
0924 02:04:25.670784 (+ 818us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260924 02:04:25.671240 3354 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:25.672135 2754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.193:39881 (request call id 19) took 839 ms (client timeout 1000 ms). Trace:
W20260924 02:04:25.672273 2754 rpcz_store.cc:269] 0924 02:04:24.832755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.671441 (+838686us) service_pool.cc:224] Handling call
0924 02:04:25.672098 (+ 657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.680539 3064 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
W20260924 02:04:25.681730 2754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.195:39331 (request call id 15) took 829 ms (client timeout 1000 ms). Trace:
W20260924 02:04:25.681897 2754 rpcz_store.cc:269] 0924 02:04:24.851512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.680045 (+828533us) service_pool.cc:224] Handling call
0924 02:04:25.681398 (+ 1353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.682763 2826 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_9d13d6a0997c452789c83619b5e41dfe" } new_table_name: "default.Table_685250380f8543c9bbaeca23f7d90fef" modify_external_catalogs: true
I20260924 02:04:25.685494 2754 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52768 (request call id 34) took 2156 ms. Trace:
I20260924 02:04:25.685776 2754 rpcz_store.cc:276] 0924 02:04:23.529181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.685094 (+2155913us) service_pool.cc:224] Handling call
0924 02:04:25.685451 (+ 357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260924 02:04:25.687740 3354 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:25.687803 3553 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:33849; Asking this server to re-register.
I20260924 02:04:25.689674 3064 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:25.693063 2754 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 35) took 2119 ms. Trace:
I20260924 02:04:25.696760 2825 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
I20260924 02:04:25.697074 2825 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
I20260924 02:04:25.697364 2754 rpcz_store.cc:276] 0924 02:04:23.573160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.692683 (+2119523us) service_pool.cc:224] Handling call
0924 02:04:25.693021 (+ 338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.697554 3553 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
W20260924 02:04:25.694155 2753 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_da49dc787bc94e6f99faf522e45a9529 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:25.698732 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:25.694969 2749 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 22) took 2848 ms. Trace:
I20260924 02:04:25.699306 2749 rpcz_store.cc:276] 0924 02:04:22.845961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.415678 (+569717us) service_pool.cc:224] Handling call
0924 02:04:24.287928 (+872250us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.694317 (+1406389us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.694570 (+ 253us) catalog_manager.cc:3764] Apply alter schema
0924 02:04:25.694880 (+ 310us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":304469,"Hive Metastore.run_cpu_time_us":1063,"Hive Metastore.run_wall_time_us":310432}
I20260924 02:04:25.699703 2754 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52768 (request call id 36) took 2048 ms. Trace:
I20260924 02:04:25.699815 2754 rpcz_store.cc:276] 0924 02:04:23.651103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.699366 (+2048263us) service_pool.cc:224] Handling call
0924 02:04:25.699667 (+ 301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.700440 2749 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 37) took 1969 ms. Trace:
I20260924 02:04:25.700534 2749 rpcz_store.cc:276] 0924 02:04:23.730541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.699605 (+1969064us) service_pool.cc:224] Handling call
0924 02:04:25.699925 (+ 320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.700726 2754 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52768 (request call id 38) took 1894 ms. Trace:
I20260924 02:04:25.700845 2754 rpcz_store.cc:276] 0924 02:04:23.806112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.699981 (+1893869us) service_pool.cc:224] Handling call
0924 02:04:25.700691 (+ 710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.700994 2749 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 39) took 1849 ms. Trace:
I20260924 02:04:25.701071 2749 rpcz_store.cc:276] 0924 02:04:23.851461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.700679 (+1849218us) service_pool.cc:224] Handling call
0924 02:04:25.700941 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.701252 2754 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 40) took 1694 ms. Trace:
I20260924 02:04:25.701361 2754 rpcz_store.cc:276] 0924 02:04:24.006526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.700992 (+1694466us) service_pool.cc:224] Handling call
0924 02:04:25.701218 (+ 226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.701508 2749 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 41) took 1172 ms. Trace:
I20260924 02:04:25.701592 2749 rpcz_store.cc:276] 0924 02:04:24.529375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.701213 (+1171838us) service_pool.cc:224] Handling call
0924 02:04:25.701452 (+ 239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:25.701889 2754 master_service.cc:960] ReplaceTablet: received request to replace tablet 17a6b94a735f453cbc7920435aa0ad28 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:25.702230 2749 master_service.cc:960] ReplaceTablet: received request to replace tablet e69bc9301d084222915283c63e3a4e9c from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:25.702360 2754 master_service.cc:960] ReplaceTablet: received request to replace tablet d12d26db47694d7387bc01063f987fd6 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:25.702600 2749 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a0e19bdca93403c8bb502ba377fac75 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:25.702656 2754 master_service.cc:960] ReplaceTablet: received request to replace tablet dc9c9a9031cb48c3a7844134859b347b from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:25.702487 2824 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_3c5dbb4d423945049a0ff011434aea7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:25.695664 2751 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 23) took 2789 ms. Trace:
I20260924 02:04:25.704252 2751 rpcz_store.cc:276] 0924 02:04:22.906478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.575554 (+669076us) service_pool.cc:224] Handling call
0924 02:04:24.288145 (+712591us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.695135 (+1406990us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.695364 (+ 229us) catalog_manager.cc:3764] Apply alter schema
0924 02:04:25.695605 (+ 241us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":614812,"Hive Metastore.run_cpu_time_us":964,"Hive Metastore.run_wall_time_us":415318}
W20260924 02:04:25.706180 3354 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.252:44061)
I20260924 02:04:25.705873 2827 catalog_manager.cc:5838] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:25.696319 2747 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52768 (request call id 13) took 3067 ms. Trace:
I20260924 02:04:25.707260 2747 rpcz_store.cc:276] 0924 02:04:22.628900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:22.628963 (+ 63us) service_pool.cc:224] Handling call
0924 02:04:24.286489 (+1657526us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.695843 (+1409354us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:25.696060 (+ 217us) catalog_manager.cc:3764] Apply alter schema
0924 02:04:25.696284 (+ 224us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1031751,"Hive Metastore.run_cpu_time_us":791,"Hive Metastore.run_wall_time_us":196670,"mutex_wait_us":1583,"spinlock_wait_cycles":3456}
I20260924 02:04:25.719530 2823 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:25.719987 2823 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:25.720108 3569 raft_consensus.cc:493] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:25.720314 3569 raft_consensus.cc:515] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.719591 2821 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:25.720616 2821 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:25.721125 3569 leader_election.cc:290] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.722281 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:25.722553 3296 raft_consensus.cc:2468] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:25.722689 2822 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_f9050bc88b744848bdda785ead091fe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:25.723194 2953 leader_election.cc:304] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.723490 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:25.723742 3156 raft_consensus.cc:2468] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:25.723829 3569 raft_consensus.cc:2804] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:25.723945 3569 raft_consensus.cc:493] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:25.724047 3569 raft_consensus.cc:3060] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.726012 2820 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_904c8f422670443ea9468dad039b48de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:25.726346 2819 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_ed7eaded3b054037b5dd91310436391b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:25.727039 2818 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_b81c77bac5c04d7c964e800c79c26424" } new_table_name: "default.Table_a87f341ff11a4093b40822eba1becb79" modify_external_catalogs: true
I20260924 02:04:25.729410 3569 raft_consensus.cc:515] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.731096 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:25.731340 3156 raft_consensus.cc:3060] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.734665 3156 raft_consensus.cc:2468] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:25.735385 2952 leader_election.cc:304] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:25.735810 3494 raft_consensus.cc:2804] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:25.746212 3569 leader_election.cc:290] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.749788 3494 raft_consensus.cc:697] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:25.750360 3494 consensus_queue.cc:237] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:25.752676 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958ced04a94b47aebff1f92b0f32ccf2" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:25.752983 3296 raft_consensus.cc:3060] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:25.757748 3296 raft_consensus.cc:2468] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:25.761003 2766 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Refusing update from remote peer 2629a26254094afb829bb3ca8fa2c593: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 2 index: 55. (index mismatch)
I20260924 02:04:25.761442 3572 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Refusing update from remote peer 2629a26254094afb829bb3ca8fa2c593: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 55. (index mismatch)
I20260924 02:04:25.762826 3640 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 4, Time since last communication: 0.000s
I20260924 02:04:25.765762 3634 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260924 02:04:25.792845 3650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629a26254094afb829bb3ca8fa2c593. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.793164 3650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:25.801328 3640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.801622 3640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:25.805936 2827 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_499006f092ed41f5b24d87bc4e22afff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:25.807027 3063 heartbeater.cc:499] Master 127.2.79.252:44061 was elected leader, sending a full tablet report...
I20260924 02:04:25.814695 3650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.814997 3650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
W20260924 02:04:25.821441 2902 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 958ced04a94b47aebff1f92b0f32ccf2 consensus state has no leader
W20260924 02:04:25.832397 2902 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 057be33fa10b4480b69af12f3800ce80 consensus state has no leader
W20260924 02:04:25.841156 2902 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8654b43c40cb4c328ea519d645b9447e consensus state has no leader
W20260924 02:04:25.869868 2814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8654b43c40cb4c328ea519d645b9447e consensus state has no leader
I20260924 02:04:25.874058 2826 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:25.876731 2826 catalog_manager.cc:5838] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9543f73523d42ad9995f4ac079044b5 (127.2.79.193). New cstate: current_term: 1 leader_uuid: "d9543f73523d42ad9995f4ac079044b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:25.877534 2826 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]). Expected version 1 got 0
I20260924 02:04:25.877928 2826 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:25.878207 2826 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:25.878547 2826 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]). Expected version 1 got 0
W20260924 02:04:25.890530 2826 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 42853fb879f54da281cd265b23129631 consensus state has no leader
I20260924 02:04:25.892673 2826 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "default.Table_4663cbdf50b8450da4834dbd10a89975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 02:04:25.898891 2824 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3c5dbb4d423945049a0ff011434aea7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:25.901733 2822 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f9050bc88b744848bdda785ead091fe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:25.903239 2820 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_904c8f422670443ea9468dad039b48de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:25.903314 2827 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_499006f092ed41f5b24d87bc4e22afff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260924 02:04:25.903314 2819 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ed7eaded3b054037b5dd91310436391b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 02:04:25.930510 2922 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:25.936266 3156 raft_consensus.cc:1275] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:25.937464 3551 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:48859; Asking this server to re-register.
I20260924 02:04:25.938508 3295 raft_consensus.cc:1275] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:25.938470 3296 raft_consensus.cc:1275] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:25.939626 3637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629a26254094afb829bb3ca8fa2c593. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.939884 3637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:25.940272 3550 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:45651; Asking this server to re-register.
I20260924 02:04:25.940526 3663 consensus_queue.cc:1048] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.940541 3634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.940773 3634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:25.941062 3663 consensus_queue.cc:1048] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.941296 3342 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:25.943216 3203 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:25.944435 3550 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:25.946372 3553 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:25.949458 3156 raft_consensus.cc:1275] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Refusing update from remote peer d9543f73523d42ad9995f4ac079044b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 02:04:25.951020 3569 consensus_queue.cc:1048] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.952345 3569 consensus_queue.cc:1048] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:25.970002 3637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:25.970299 3637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:26.013684 3685 tablet.cc:1751] T 958ced04a94b47aebff1f92b0f32ccf2 P c3d5f64871b3487b9705befe2938e289: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.017833 3684 tablet.cc:1751] T 958ced04a94b47aebff1f92b0f32ccf2 P d9543f73523d42ad9995f4ac079044b5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.044963 3341 heartbeater.cc:499] Master 127.2.79.252:44061 was elected leader, sending a full tablet report...
I20260924 02:04:26.050408 3684 tablet.cc:1751] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.065428 3678 consensus_queue.cc:1048] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.078784 3685 tablet.cc:1751] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.130460 3666 mvcc.cc:204] Tried to move back new op lower bound from 7332722547687591936 to 7332722546547056640. Current Snapshot: MvccSnapshot[applied={T|T < 7332722547687591936 or (T in {7332722547687591936})}]
I20260924 02:04:26.144161 3687 mvcc.cc:204] Tried to move back new op lower bound from 7332722548465332224 to 7332722545857658880. Current Snapshot: MvccSnapshot[applied={T|T < 7332722548465332224}]
I20260924 02:04:26.144898 3676 consensus_queue.cc:1048] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.151062 3694 tablet.cc:1751] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.157910 3683 consensus_queue.cc:1048] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.158496 3683 consensus_queue.cc:1048] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.168754 3696 tablet.cc:1751] T 958ced04a94b47aebff1f92b0f32ccf2 P 79827750d7ae4673803de4e9415165e6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:26.363590 3693 consensus_queue.cc:1048] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.370201 3693 consensus_queue.cc:1048] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.388514 3704 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:26.389317 3704 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:26.443078 2836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 3 candidate_status { last_received { term: 2 index: 61 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:26.444880 3704 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:26.453253 3572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 3 candidate_status { last_received { term: 2 index: 61 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:26.454106 3692 consensus_queue.cc:1048] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.455591 2743 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:26.457217 3704 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260924 02:04:26.461122 3637 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:26.461383 3637 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:26.464306 3637 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:26.465129 2836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 3 candidate_status { last_received { term: 2 index: 61 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:26.465230 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 3 candidate_status { last_received { term: 2 index: 61 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:26.466202 3515 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:26.466693 3637 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260924 02:04:26.467821 3692 consensus_queue.cc:1048] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.475884 3686 consensus_queue.cc:1048] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.516853 3692 consensus_queue.cc:1048] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:26.551249 3656 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:26.551486 3656 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: loading cluster ID for follower catalog manager: success
I20260924 02:04:26.557446 3656 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: acquiring CA information for follower catalog manager: success
I20260924 02:04:26.561244 3656 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:26.702623 2825 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
W20260924 02:04:26.706007 2918 hms_client.cc:355] Time spent drop HMS table: real 1.040s user 0.000s sys 0.000s
I20260924 02:04:26.706243 2755 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=0581ca27a28b4a588e3e0c18bf5b126d]
I20260924 02:04:26.706782 2755 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 20) took 3968 ms. Trace:
I20260924 02:04:26.706910 2755 rpcz_store.cc:276] 0924 02:04:22.738712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.077092 (+338380us) service_pool.cc:224] Handling call
0924 02:04:24.288371 (+1211279us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:24.288842 (+ 471us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:25.588299 (+1299457us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:25.589362 (+ 1063us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.589367 (+ 5us) write_op.cc:454] Released schema lock
0924 02:04:25.589753 (+ 386us) catalog_manager.cc:2220] Rolling back HMS table creation
0924 02:04:26.706711 (+1116958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:25.589156 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER)
0924 02:04:25.589173 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.589181 (+ 8us) write_op.cc:454] Released schema lock
0924 02:04:25.589185 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1301839,"Hive Metastore.run_cpu_time_us":938,"Hive Metastore.run_wall_time_us":1113442,"child_traces":[["op",{}]]}
W20260924 02:04:26.708623 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:26.838541 2824 catalog_manager.cc:2213] created HMS catalog entry for table [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:26.865828 2750 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=961cf5019ff2456cb02f5fbdfb895264]
I20260924 02:04:26.866290 2750 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 24) took 3819 ms. Trace:
I20260924 02:04:26.866405 2750 rpcz_store.cc:276] 0924 02:04:23.047142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.663978 (+616836us) service_pool.cc:224] Handling call
0924 02:04:23.683756 (+ 19778us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x616000042a54. stack: 00007f2d9107c5c6 00007f2d9107c380 00007f2d9008434d 00000000009a4cb4 00000000009a4c7d 00007f2da05f665d 00007f2da05f6753 00007f2d9d173db1 00007f2da4f62acd 00007f2da50f1ef3 00007f2d9bac2d16 00007f2d9bac2a45 00007f2d981c663e 00007f2d981c551e 00007f2d981cb758 00007f2d981cc0bf
0924 02:04:24.290028 (+606272us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:24.290510 (+ 482us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:25.629693 (+1339183us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:25.630635 (+ 942us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.630639 (+ 4us) write_op.cc:454] Released schema lock
0924 02:04:25.630985 (+ 346us) catalog_manager.cc:2220] Rolling back HMS table creation
0924 02:04:26.866209 (+1235224us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:25.630551 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER)
0924 02:04:25.630566 (+ 15us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.630574 (+ 8us) write_op.cc:454] Released schema lock
0924 02:04:25.630579 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":2372567,"Hive Metastore.run_cpu_time_us":645,"Hive Metastore.run_wall_time_us":200832,"spinlock_wait_cycles":44569984,"child_traces":[["op",{}]]}
I20260924 02:04:26.906231 2824 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40094 (request call id 6) took 1204 ms. Trace:
I20260924 02:04:26.906509 2824 rpcz_store.cc:276] 0924 02:04:25.701871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.701939 (+ 68us) service_pool.cc:224] Handling call
0924 02:04:25.899238 (+197299us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:25.900572 (+ 1334us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:26.838482 (+937910us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:26.905734 (+ 67252us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:26.905913 (+ 179us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:26.906183 (+ 270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:26.849901 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:26.850053 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:26.850062 (+ 9us) write_op.cc:435] Acquired schema lock
0924 02:04:26.850064 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:26.850173 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:26.850188 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:26.850193 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:26.850299 (+ 106us) tablet.cc:701] Row locks acquired
0924 02:04:26.850301 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:26.850341 (+ 40us) write_op.cc:270] Start()
0924 02:04:26.850382 (+ 41us) write_op.cc:276] Timestamp: P: 1790215466850312 usec, L: 0
0924 02:04:26.850386 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:26.850738 (+ 352us) log.cc:844] Serialized 432 byte log entry
0924 02:04:26.891149 (+ 40411us) op_driver.cc:464] REPLICATION: finished
0924 02:04:26.895954 (+ 4805us) write_op.cc:301] APPLY: starting
0924 02:04:26.895978 (+ 24us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:26.896032 (+ 54us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:26.904896 (+ 8864us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:26.905059 (+ 163us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:26.905105 (+ 46us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:26.905114 (+ 9us) write_op.cc:312] APPLY: finished
0924 02:04:26.905232 (+ 118us) log.cc:844] Serialized 28 byte log entry
0924 02:04:26.905591 (+ 359us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.905618 (+ 27us) write_op.cc:454] Released schema lock
0924 02:04:26.905626 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:26.905724 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.905728 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":801232,"Hive Metastore.run_cpu_time_us":573,"Hive Metastore.run_wall_time_us":136015,"child_traces":[["op",{"apply.queue_time_us":4701,"apply.run_cpu_time_us":719,"apply.run_wall_time_us":9772,"num_ops":2,"prepare.queue_time_us":10525,"prepare.run_cpu_time_us":1038,"prepare.run_wall_time_us":21707,"raft.queue_time_us":209,"raft.run_cpu_time_us":859,"raft.run_wall_time_us":861,"replication_time_us":40709,"thread_start_us":17257,"threads_started":2}]]}
I20260924 02:04:26.916067 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]). Expected version 1 got 0
W20260924 02:04:26.917640 2824 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.194:55887 (request call id 54) took 944 ms (client timeout 1000 ms). Trace:
W20260924 02:04:26.917879 2824 rpcz_store.cc:269] 0924 02:04:25.973467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:26.914633 (+941166us) service_pool.cc:224] Handling call
0924 02:04:26.917516 (+ 2883us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":703232}
I20260924 02:04:26.919217 3202 heartbeater.cc:499] Master 127.2.79.252:44061 was elected leader, sending a full tablet report...
I20260924 02:04:26.929754 2996 tablet_service.cc:1511] Processing CreateTablet for tablet ae040db05d8b477392beb0d413e25b5f (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:26.930279 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae040db05d8b477392beb0d413e25b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:26.930605 2824 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8] alter complete (version 1)
W20260924 02:04:26.931424 2824 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.193:46215 (request call id 64) took 871 ms (client timeout 1000 ms). Trace:
W20260924 02:04:26.931792 2824 rpcz_store.cc:269] 0924 02:04:26.060110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:26.918378 (+858268us) service_pool.cc:224] Handling call
0924 02:04:26.931378 (+ 13000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:26.920683 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:26.920800 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:26.920806 (+ 6us) write_op.cc:435] Acquired schema lock
0924 02:04:26.920809 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:26.920913 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:26.920927 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:26.920934 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0924 02:04:26.921016 (+ 82us) tablet.cc:701] Row locks acquired
0924 02:04:26.921020 (+ 4us) write_op.cc:260] PREPARE: finished
0924 02:04:26.921060 (+ 40us) write_op.cc:270] Start()
0924 02:04:26.921098 (+ 38us) write_op.cc:276] Timestamp: P: 1790215466921026 usec, L: 0
0924 02:04:26.921104 (+ 6us) op_driver.cc:348] REPLICATION: starting
0924 02:04:26.921302 (+ 198us) log.cc:844] Serialized 355 byte log entry
0924 02:04:26.926773 (+ 5471us) op_driver.cc:464] REPLICATION: finished
0924 02:04:26.927461 (+ 688us) write_op.cc:301] APPLY: starting
0924 02:04:26.927480 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:26.927524 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:26.927559 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:26.927613 (+ 54us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:26.927647 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:26.927657 (+ 10us) write_op.cc:312] APPLY: finished
0924 02:04:26.927778 (+ 121us) log.cc:844] Serialized 22 byte log entry
0924 02:04:26.930203 (+ 2425us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.930230 (+ 27us) write_op.cc:454] Released schema lock
0924 02:04:26.930242 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:26.930333 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.930337 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":614,"apply.run_cpu_time_us":545,"apply.run_wall_time_us":2869,"num_ops":1,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":1147,"replication_time_us":5634}]]}
I20260924 02:04:26.937563 2824 catalog_manager.cc:5838] T 0ca399002f6a489cbdddbbec7b0cc4a7 P 79827750d7ae4673803de4e9415165e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79827750d7ae4673803de4e9415165e6 (127.2.79.195). New cstate: current_term: 1 leader_uuid: "79827750d7ae4673803de4e9415165e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:26.951452 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:26.951965 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]). Expected version 1 got 0
I20260924 02:04:26.952214 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:26.952412 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:26.952615 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]). Expected version 1 got 0
I20260924 02:04:26.952873 2824 catalog_manager.cc:5838] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79827750d7ae4673803de4e9415165e6 (127.2.79.195). New cstate: current_term: 1 leader_uuid: "79827750d7ae4673803de4e9415165e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:26.960489 3726 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:26.965426 3726 tablet_bootstrap.cc:654] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:26.981967 3726 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:26.982312 3726 ts_tablet_manager.cc:1403] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.005s
W20260924 02:04:26.983201 2824 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.79.195:35405 (request call id 54) took 848 ms (client timeout 1000 ms). Trace:
I20260924 02:04:26.983409 3726 raft_consensus.cc:359] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:26.983762 3726 raft_consensus.cc:385] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:26.983920 3726 raft_consensus.cc:740] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
W20260924 02:04:26.983511 2824 rpcz_store.cc:269] 0924 02:04:26.134764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:26.932703 (+797939us) service_pool.cc:224] Handling call
0924 02:04:26.983122 (+ 50419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:26.954607 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:26.954793 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:26.954799 (+ 6us) write_op.cc:435] Acquired schema lock
0924 02:04:26.954801 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:26.955072 (+ 271us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:26.955088 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:26.955093 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:26.955253 (+ 160us) tablet.cc:701] Row locks acquired
0924 02:04:26.955255 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:26.955301 (+ 46us) write_op.cc:270] Start()
0924 02:04:26.955355 (+ 54us) write_op.cc:276] Timestamp: P: 1790215466955264 usec, L: 0
0924 02:04:26.955358 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:26.955657 (+ 299us) log.cc:844] Serialized 906 byte log entry
0924 02:04:26.959655 (+ 3998us) op_driver.cc:464] REPLICATION: finished
0924 02:04:26.959759 (+ 104us) write_op.cc:301] APPLY: starting
0924 02:04:26.959777 (+ 18us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:26.959851 (+ 74us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:26.959876 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:26.959947 (+ 71us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:26.959981 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0924 02:04:26.959990 (+ 9us) write_op.cc:312] APPLY: finished
0924 02:04:26.960079 (+ 89us) log.cc:844] Serialized 28 byte log entry
0924 02:04:26.960147 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.960175 (+ 28us) write_op.cc:454] Released schema lock
0924 02:04:26.960186 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:26.960270 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:26.960274 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":33,"apply.run_cpu_time_us":502,"apply.run_wall_time_us":502,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":1119,"prepare.run_wall_time_us":1188,"raft.queue_time_us":642,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":336,"replication_time_us":4250}]]}
I20260924 02:04:26.984340 3726 consensus_queue.cc:260] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:26.986987 3726 ts_tablet_manager.cc:1434] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260924 02:04:26.994562 3275 tablet_service.cc:1511] Processing CreateTablet for tablet ae040db05d8b477392beb0d413e25b5f (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:26.995121 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae040db05d8b477392beb0d413e25b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:26.996269 3136 tablet_service.cc:1511] Processing CreateTablet for tablet ae040db05d8b477392beb0d413e25b5f (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:26.996814 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae040db05d8b477392beb0d413e25b5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260924 02:04:27.004616 2814 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8654b43c40cb4c328ea519d645b9447e consensus state has no leader
I20260924 02:04:27.009105 2823 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:27.017978 2824 catalog_manager.cc:5838] T 42853fb879f54da281cd265b23129631 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:27.018596 3731 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.022183 3731 tablet_bootstrap.cc:654] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.027026 3730 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.027912 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:27.028643 2824 catalog_manager.cc:5838] T 8654b43c40cb4c328ea519d645b9447e P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:27.029171 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:27.029606 2824 catalog_manager.cc:5838] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d5f64871b3487b9705befe2938e289 (127.2.79.194). New cstate: current_term: 1 leader_uuid: "c3d5f64871b3487b9705befe2938e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } }
I20260924 02:04:27.030041 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:27.033039 3730 tablet_bootstrap.cc:654] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.049804 3731 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.050170 3731 ts_tablet_manager.cc:1403] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.000s
I20260924 02:04:27.051266 3731 raft_consensus.cc:359] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.051605 3731 raft_consensus.cc:385] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.051760 3731 raft_consensus.cc:740] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.052146 3731 consensus_queue.cc:260] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.055272 2824 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c] alter complete (version 1)
I20260924 02:04:27.059361 3731 ts_tablet_manager.cc:1434] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260924 02:04:27.061818 2824 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:27.062314 2824 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:27.063011 2824 catalog_manager.cc:5938] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:27.067086 3714 raft_consensus.cc:493] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:27.067308 3714 raft_consensus.cc:515] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.069432 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:27.070926 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:27.071223 3294 raft_consensus.cc:2468] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:27.072088 3683 raft_consensus.cc:493] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:27.072271 3683 raft_consensus.cc:515] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.073064 3683 leader_election.cc:290] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:27.074364 2752 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=c37207c1f21240d2a775eb44253222d1]
I20260924 02:04:27.074728 2752 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 25) took 3968 ms. Trace:
I20260924 02:04:27.074849 2752 rpcz_store.cc:276] 0924 02:04:23.106527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:23.890612 (+784085us) service_pool.cc:224] Handling call
0924 02:04:24.321655 (+431043us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:24.322492 (+ 837us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:25.659116 (+1336624us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:25.660067 (+ 951us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.660071 (+ 4us) write_op.cc:454] Released schema lock
0924 02:04:25.660332 (+ 261us) catalog_manager.cc:2220] Rolling back HMS table creation
0924 02:04:27.074687 (+1414355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:25.659981 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER)
0924 02:04:25.659994 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:25.660002 (+ 8us) write_op.cc:454] Released schema lock
0924 02:04:25.660007 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":2512152,"Hive Metastore.run_cpu_time_us":740,"Hive Metastore.run_wall_time_us":237853,"child_traces":[["op",{}]]}
W20260924 02:04:27.076792 2952 leader_election.cc:343] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:27.077237 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:27.077507 3018 raft_consensus.cc:2468] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:27.078666 2953 leader_election.cc:304] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters: c3d5f64871b3487b9705befe2938e289
I20260924 02:04:27.079330 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
W20260924 02:04:27.080272 3230 leader_election.cc:343] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:27.080680 3714 leader_election.cc:290] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.081207 3569 raft_consensus.cc:2804] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:27.081327 3569 raft_consensus.cc:493] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:27.081406 3569 raft_consensus.cc:3060] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.088594 3229 leader_election.cc:304] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters: c3d5f64871b3487b9705befe2938e289
I20260924 02:04:27.089280 3683 raft_consensus.cc:2804] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:27.089403 3683 raft_consensus.cc:493] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:27.089480 3683 raft_consensus.cc:3060] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.091280 3730 tablet_bootstrap.cc:492] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.091442 3730 ts_tablet_manager.cc:1403] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.003s
I20260924 02:04:27.092306 3730 raft_consensus.cc:359] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.092362 3683 raft_consensus.cc:515] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.092510 3730 raft_consensus.cc:385] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.092613 3730 raft_consensus.cc:740] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.093746 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:27.099481 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:27.100617 3730 consensus_queue.cc:260] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.084890 3569 raft_consensus.cc:515] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.102090 3569 leader_election.cc:290] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.103135 3157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:27.102385 3018 raft_consensus.cc:2393] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79827750d7ae4673803de4e9415165e6 in current term 1: Already voted for candidate d9543f73523d42ad9995f4ac079044b5 in this term.
I20260924 02:04:27.104429 3156 raft_consensus.cc:3060] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.107997 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae040db05d8b477392beb0d413e25b5f" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:27.108285 3294 raft_consensus.cc:2393] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d9543f73523d42ad9995f4ac079044b5 in current term 1: Already voted for candidate 79827750d7ae4673803de4e9415165e6 in this term.
I20260924 02:04:27.109638 2953 leader_election.cc:304] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9543f73523d42ad9995f4ac079044b5; no voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289
I20260924 02:04:27.115366 3156 raft_consensus.cc:2468] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:27.116451 3230 leader_election.cc:304] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters: d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:27.123471 3569 raft_consensus.cc:2749] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260924 02:04:27.124002 3683 leader_election.cc:290] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:27.126995 3741 raft_consensus.cc:2804] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:27.127396 3741 raft_consensus.cc:697] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Becoming Leader. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Running, Role: LEADER
I20260924 02:04:27.127962 3741 consensus_queue.cc:237] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } }
I20260924 02:04:27.131887 3730 ts_tablet_manager.cc:1434] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.040s user 0.003s sys 0.001s
I20260924 02:04:27.136112 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]). Expected version 1 got 0
I20260924 02:04:27.138695 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:27.139201 2824 catalog_manager.cc:5938] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:27.175518 3747 tablet.cc:1751] T 057be33fa10b4480b69af12f3800ce80 P d9543f73523d42ad9995f4ac079044b5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:27.183681 3749 tablet.cc:1751] T 057be33fa10b4480b69af12f3800ce80 P 79827750d7ae4673803de4e9415165e6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:27.186359 3748 tablet.cc:1751] T 057be33fa10b4480b69af12f3800ce80 P c3d5f64871b3487b9705befe2938e289: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260924 02:04:27.187740 2824 catalog_manager.cc:5838] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79827750d7ae4673803de4e9415165e6 (127.2.79.195). New cstate: current_term: 1 leader_uuid: "79827750d7ae4673803de4e9415165e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } health_report { overall_health: UNKNOWN } } }
I20260924 02:04:27.224367 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]). Expected version 1 got 0
I20260924 02:04:27.246658 2824 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4] alter complete (version 1)
I20260924 02:04:27.271926 2824 master_service.cc:960] ReplaceTablet: received request to replace tablet 17a6b94a735f453cbc7920435aa0ad28 from {username='slave'} at 127.0.0.1:40094
I20260924 02:04:27.272588 2824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40094 (request call id 16) took 1545 ms. Trace:
I20260924 02:04:27.272722 2824 rpcz_store.cc:276] 0924 02:04:25.726602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:27.271714 (+1545112us) service_pool.cc:224] Handling call
0924 02:04:27.272537 (+ 823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260924 02:04:27.273084 2824 master_service.cc:960] ReplaceTablet: received request to replace tablet e69bc9301d084222915283c63e3a4e9c from {username='slave'} at 127.0.0.1:40094
I20260924 02:04:27.285534 2824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Sending DeleteTablet for 3 replicas of tablet e69bc9301d084222915283c63e3a4e9c
I20260924 02:04:27.287954 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bc9301d084222915283c63e3a4e9c with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab1d437fd4456a939b52c636395722) from {username='slave'} at 127.0.0.1:36600
I20260924 02:04:27.294533 3275 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bc9301d084222915283c63e3a4e9c with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab1d437fd4456a939b52c636395722) from {username='slave'} at 127.0.0.1:60136
I20260924 02:04:27.305439 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bc9301d084222915283c63e3a4e9c with delete_type TABLET_DATA_DELETED (replaced by tablet a2ab1d437fd4456a939b52c636395722) from {username='slave'} at 127.0.0.1:60238
I20260924 02:04:27.311573 2824 catalog_manager.cc:6934] ReplaceTablet: tablet e69bc9301d084222915283c63e3a4e9c deleted and replaced by tablet a2ab1d437fd4456a939b52c636395722
I20260924 02:04:27.312153 2824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40094 (request call id 17) took 1585 ms. Trace:
I20260924 02:04:27.322355 3137 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab1d437fd4456a939b52c636395722 (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.323010 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab1d437fd4456a939b52c636395722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.323616 2998 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab1d437fd4456a939b52c636395722 (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.324100 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab1d437fd4456a939b52c636395722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.330243 3730 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.332687 3730 tablet_bootstrap.cc:654] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.342046 3726 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:27.345044 3726 tablet_bootstrap.cc:654] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.360075 3276 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab1d437fd4456a939b52c636395722 (DEFAULT_TABLE table=default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.359869 2824 rpcz_store.cc:276] 0924 02:04:25.726755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:27.273016 (+1546261us) service_pool.cc:224] Handling call
0924 02:04:27.312085 (+ 39069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.275632 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:27.275788 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:27.275796 (+ 8us) write_op.cc:435] Acquired schema lock
0924 02:04:27.275799 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:27.275935 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:27.275953 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:27.275959 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:27.276054 (+ 95us) tablet.cc:701] Row locks acquired
0924 02:04:27.276056 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:27.276097 (+ 41us) write_op.cc:270] Start()
0924 02:04:27.276143 (+ 46us) write_op.cc:276] Timestamp: P: 1790215467276075 usec, L: 0
0924 02:04:27.276146 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:27.276424 (+ 278us) log.cc:844] Serialized 658 byte log entry
0924 02:04:27.284295 (+ 7871us) op_driver.cc:464] REPLICATION: finished
0924 02:04:27.284412 (+ 117us) write_op.cc:301] APPLY: starting
0924 02:04:27.284435 (+ 23us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:27.284489 (+ 54us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:27.284530 (+ 41us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:27.284656 (+ 126us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:27.284723 (+ 67us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:27.284730 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:27.284868 (+ 138us) log.cc:844] Serialized 28 byte log entry
0924 02:04:27.284956 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.284985 (+ 29us) write_op.cc:454] Released schema lock
0924 02:04:27.284993 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:27.285088 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.285094 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":661,"apply.run_wall_time_us":661,"num_ops":2,"prepare.queue_time_us":1303,"prepare.run_cpu_time_us":926,"prepare.run_wall_time_us":925,"raft.queue_time_us":1498,"raft.run_cpu_time_us":614,"raft.run_wall_time_us":612,"replication_time_us":8109}]]}
I20260924 02:04:27.360651 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab1d437fd4456a939b52c636395722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.361231 2824 master_service.cc:960] ReplaceTablet: received request to replace tablet d12d26db47694d7387bc01063f987fd6 from {username='slave'} at 127.0.0.1:40094
I20260924 02:04:27.373509 3726 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:27.373751 3726 ts_tablet_manager.cc:1403] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.003s
I20260924 02:04:27.374650 3726 raft_consensus.cc:359] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.375474 3751 tablet_replica.cc:333] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:27.375766 3751 raft_consensus.cc:2243] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.376039 3751 raft_consensus.cc:2272] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.376729 3751 ts_tablet_manager.cc:1916] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.380118 3730 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.380424 3730 ts_tablet_manager.cc:1403] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.008s
I20260924 02:04:27.381392 3730 raft_consensus.cc:359] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.381721 3730 raft_consensus.cc:385] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.381876 3730 raft_consensus.cc:740] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.382272 3730 consensus_queue.cc:260] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.391880 3750 tablet_replica.cc:333] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:27.393093 3750 raft_consensus.cc:2243] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:27.393600 3750 raft_consensus.cc:2272] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.394325 3750 ts_tablet_manager.cc:1916] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.394665 3730 ts_tablet_manager.cc:1434] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260924 02:04:27.397507 3731 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.374905 3726 raft_consensus.cc:385] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.398170 2824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Sending DeleteTablet for 3 replicas of tablet d12d26db47694d7387bc01063f987fd6
I20260924 02:04:27.398243 3726 raft_consensus.cc:740] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.398725 3726 consensus_queue.cc:260] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.399104 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d26db47694d7387bc01063f987fd6 with delete_type TABLET_DATA_DELETED (replaced by tablet d42ebee0a393495ba5e792b81938b516) from {username='slave'} at 127.0.0.1:36600
I20260924 02:04:27.399549 3731 tablet_bootstrap.cc:654] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.400630 3276 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d26db47694d7387bc01063f987fd6 with delete_type TABLET_DATA_DELETED (replaced by tablet d42ebee0a393495ba5e792b81938b516) from {username='slave'} at 127.0.0.1:60136
I20260924 02:04:27.401158 2824 catalog_manager.cc:6934] ReplaceTablet: tablet d12d26db47694d7387bc01063f987fd6 deleted and replaced by tablet d42ebee0a393495ba5e792b81938b516
I20260924 02:04:27.401378 2824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40094 (request call id 18) took 1674 ms. Trace:
I20260924 02:04:27.401528 2824 rpcz_store.cc:276] 0924 02:04:25.726896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:27.361129 (+1634233us) service_pool.cc:224] Handling call
0924 02:04:27.401345 (+ 40216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.362592 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:27.362725 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:27.362732 (+ 7us) write_op.cc:435] Acquired schema lock
0924 02:04:27.362734 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:27.362873 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:27.362890 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:27.362896 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:27.363061 (+ 165us) tablet.cc:701] Row locks acquired
0924 02:04:27.363065 (+ 4us) write_op.cc:260] PREPARE: finished
0924 02:04:27.363111 (+ 46us) write_op.cc:270] Start()
0924 02:04:27.363151 (+ 40us) write_op.cc:276] Timestamp: P: 1790215467363083 usec, L: 0
0924 02:04:27.363155 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:27.363364 (+ 209us) log.cc:844] Serialized 658 byte log entry
0924 02:04:27.377613 (+ 14249us) op_driver.cc:464] REPLICATION: finished
0924 02:04:27.377768 (+ 155us) write_op.cc:301] APPLY: starting
0924 02:04:27.377790 (+ 22us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:27.377849 (+ 59us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:27.377881 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:27.378001 (+ 120us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:27.378072 (+ 71us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:27.378079 (+ 7us) write_op.cc:312] APPLY: finished
0924 02:04:27.378176 (+ 97us) log.cc:844] Serialized 28 byte log entry
0924 02:04:27.378252 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.378301 (+ 49us) write_op.cc:454] Released schema lock
0924 02:04:27.378309 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:27.378439 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.378444 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":657,"apply.run_wall_time_us":656,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":932,"prepare.run_wall_time_us":933,"raft.queue_time_us":670,"raft.run_cpu_time_us":677,"raft.run_wall_time_us":676,"replication_time_us":14417}]]}
I20260924 02:04:27.410080 3726 ts_tablet_manager.cc:1434] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260924 02:04:27.402300 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d26db47694d7387bc01063f987fd6 with delete_type TABLET_DATA_DELETED (replaced by tablet d42ebee0a393495ba5e792b81938b516) from {username='slave'} at 127.0.0.1:60238
I20260924 02:04:27.415406 3752 tablet_replica.cc:333] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:27.417163 3752 raft_consensus.cc:2243] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.417608 3752 raft_consensus.cc:2272] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.418370 3752 ts_tablet_manager.cc:1916] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.425431 3731 tablet_bootstrap.cc:492] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.425843 3731 ts_tablet_manager.cc:1403] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.006s
I20260924 02:04:27.427156 3731 raft_consensus.cc:359] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.427260 2824 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a0e19bdca93403c8bb502ba377fac75 from {username='slave'} at 127.0.0.1:40094
I20260924 02:04:27.427595 3731 raft_consensus.cc:385] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.427801 3731 raft_consensus.cc:740] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.428501 3137 tablet_service.cc:1511] Processing CreateTablet for tablet d42ebee0a393495ba5e792b81938b516 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.428754 3731 consensus_queue.cc:260] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.429502 3731 ts_tablet_manager.cc:1434] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260924 02:04:27.463032 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42ebee0a393495ba5e792b81938b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.467084 2821 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:27.470515 2996 tablet_service.cc:1511] Processing CreateTablet for tablet d42ebee0a393495ba5e792b81938b516 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.471312 2824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Sending DeleteTablet for 3 replicas of tablet 0a0e19bdca93403c8bb502ba377fac75
I20260924 02:04:27.472474 3275 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 with delete_type TABLET_DATA_DELETED (replaced by tablet e1dbf6dbef74400d9c54d1bc44333982) from {username='slave'} at 127.0.0.1:60136
I20260924 02:04:27.473526 2998 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 with delete_type TABLET_DATA_DELETED (replaced by tablet e1dbf6dbef74400d9c54d1bc44333982) from {username='slave'} at 127.0.0.1:36600
I20260924 02:04:27.473873 3135 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a0e19bdca93403c8bb502ba377fac75 with delete_type TABLET_DATA_DELETED (replaced by tablet e1dbf6dbef74400d9c54d1bc44333982) from {username='slave'} at 127.0.0.1:60238
I20260924 02:04:27.475867 3730 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.478443 3730 tablet_bootstrap.cc:654] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.494081 3730 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.494388 3730 ts_tablet_manager.cc:1403] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260924 02:04:27.495726 3730 raft_consensus.cc:359] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.496310 3730 raft_consensus.cc:385] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.497442 3730 raft_consensus.cc:740] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.497896 3730 consensus_queue.cc:260] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.502089 3730 ts_tablet_manager.cc:1434] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260924 02:04:27.505465 2998 tablet_service.cc:1511] Processing CreateTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.507011 3275 tablet_service.cc:1511] Processing CreateTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.508121 3137 tablet_service.cc:1511] Processing CreateTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.519032 2824 catalog_manager.cc:6934] ReplaceTablet: tablet 0a0e19bdca93403c8bb502ba377fac75 deleted and replaced by tablet e1dbf6dbef74400d9c54d1bc44333982
I20260924 02:04:27.519275 2824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40094 (request call id 19) took 1792 ms. Trace:
I20260924 02:04:27.519392 2824 rpcz_store.cc:276] 0924 02:04:25.727063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:27.427112 (+1700049us) service_pool.cc:224] Handling call
0924 02:04:27.519210 (+ 92098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.434579 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:27.434739 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:27.434747 (+ 8us) write_op.cc:435] Acquired schema lock
0924 02:04:27.434750 (+ 3us) tablet.cc:662] Decoding operations
0924 02:04:27.434881 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:27.434898 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:27.434904 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:27.435692 (+ 788us) tablet.cc:701] Row locks acquired
0924 02:04:27.435695 (+ 3us) write_op.cc:260] PREPARE: finished
0924 02:04:27.435746 (+ 51us) write_op.cc:270] Start()
0924 02:04:27.435797 (+ 51us) write_op.cc:276] Timestamp: P: 1790215467435711 usec, L: 0
0924 02:04:27.435800 (+ 3us) op_driver.cc:348] REPLICATION: starting
0924 02:04:27.436058 (+ 258us) log.cc:844] Serialized 658 byte log entry
0924 02:04:27.458128 (+ 22070us) op_driver.cc:464] REPLICATION: finished
0924 02:04:27.459079 (+ 951us) write_op.cc:301] APPLY: starting
0924 02:04:27.459113 (+ 34us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:27.459189 (+ 76us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:27.459224 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:27.459516 (+ 292us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:27.459619 (+ 103us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:27.459627 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:27.459768 (+ 141us) log.cc:844] Serialized 28 byte log entry
0924 02:04:27.459890 (+ 122us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.459923 (+ 33us) write_op.cc:454] Released schema lock
0924 02:04:27.459933 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:27.460045 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.460050 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":854,"apply.run_cpu_time_us":964,"apply.run_wall_time_us":964,"num_ops":2,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":965,"prepare.run_wall_time_us":1563,"replication_time_us":22282}]]}
I20260924 02:04:27.522475 3276 tablet_service.cc:1511] Processing CreateTablet for tablet d42ebee0a393495ba5e792b81938b516 (DEFAULT_TABLE table=default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.531592 2824 catalog_manager.cc:5938] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273) does not have the latest schema for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]). Expected version 1 got 0
I20260924 02:04:27.534854 2824 master_service.cc:960] ReplaceTablet: received request to replace tablet dc9c9a9031cb48c3a7844134859b347b from {username='slave'} at 127.0.0.1:40094
I20260924 02:04:27.546175 2824 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Sending DeleteTablet for 3 replicas of tablet dc9c9a9031cb48c3a7844134859b347b
I20260924 02:04:27.547788 2997 tablet_service.cc:1558] Processing DeleteTablet for tablet dc9c9a9031cb48c3a7844134859b347b with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb0a9028ad343b8aa431e1cc921c3f5) from {username='slave'} at 127.0.0.1:36600
I20260924 02:04:27.548579 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet dc9c9a9031cb48c3a7844134859b347b with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb0a9028ad343b8aa431e1cc921c3f5) from {username='slave'} at 127.0.0.1:60136
I20260924 02:04:27.548678 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet dc9c9a9031cb48c3a7844134859b347b with delete_type TABLET_DATA_DELETED (replaced by tablet 8fb0a9028ad343b8aa431e1cc921c3f5) from {username='slave'} at 127.0.0.1:60238
I20260924 02:04:27.548990 2824 catalog_manager.cc:6934] ReplaceTablet: tablet dc9c9a9031cb48c3a7844134859b347b deleted and replaced by tablet 8fb0a9028ad343b8aa431e1cc921c3f5
I20260924 02:04:27.549191 2824 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40094 (request call id 20) took 1821 ms. Trace:
I20260924 02:04:27.549307 2824 rpcz_store.cc:276] 0924 02:04:25.727160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:27.534769 (+1807609us) service_pool.cc:224] Handling call
0924 02:04:27.549113 (+ 14344us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.536170 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:27.536298 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:27.536303 (+ 5us) write_op.cc:435] Acquired schema lock
0924 02:04:27.536305 (+ 2us) tablet.cc:662] Decoding operations
0924 02:04:27.536472 (+ 167us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:27.536489 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:27.536495 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:27.536589 (+ 94us) tablet.cc:701] Row locks acquired
0924 02:04:27.536591 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:27.536635 (+ 44us) write_op.cc:270] Start()
0924 02:04:27.536697 (+ 62us) write_op.cc:276] Timestamp: P: 1790215467536594 usec, L: 0
0924 02:04:27.536703 (+ 6us) op_driver.cc:348] REPLICATION: starting
0924 02:04:27.536924 (+ 221us) log.cc:844] Serialized 658 byte log entry
0924 02:04:27.542098 (+ 5174us) op_driver.cc:464] REPLICATION: finished
0924 02:04:27.542580 (+ 482us) write_op.cc:301] APPLY: starting
0924 02:04:27.542608 (+ 28us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:27.542651 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:27.542676 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:27.542782 (+ 106us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:27.542837 (+ 55us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0924 02:04:27.542845 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:27.542920 (+ 75us) log.cc:844] Serialized 28 byte log entry
0924 02:04:27.543056 (+ 136us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.543082 (+ 26us) write_op.cc:454] Released schema lock
0924 02:04:27.543090 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:27.543172 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.543176 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":366,"apply.run_cpu_time_us":593,"apply.run_wall_time_us":592,"num_ops":2,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":932,"prepare.run_wall_time_us":932,"raft.queue_time_us":503,"raft.run_cpu_time_us":653,"raft.run_wall_time_us":652,"replication_time_us":5350}]]}
I20260924 02:04:27.550259 2824 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_4fd30425787341509cfacfe3c2b7ad27" } new_table_name: "default.Table_1a94f2e11784451691899fad0e5660d6" modify_external_catalogs: true
I20260924 02:04:27.555449 3750 ts_tablet_manager.cc:1929] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.555639 3750 log.cc:1199] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/e69bc9301d084222915283c63e3a4e9c
I20260924 02:04:27.556159 3750 ts_tablet_manager.cc:1950] T e69bc9301d084222915283c63e3a4e9c P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:27.556684 3751 ts_tablet_manager.cc:1929] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.556828 3751 log.cc:1199] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/e69bc9301d084222915283c63e3a4e9c
I20260924 02:04:27.557263 3751 ts_tablet_manager.cc:1950] T e69bc9301d084222915283c63e3a4e9c P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:27.557742 3752 ts_tablet_manager.cc:1929] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.557888 3752 log.cc:1199] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/e69bc9301d084222915283c63e3a4e9c
I20260924 02:04:27.558331 3752 ts_tablet_manager.cc:1950] T e69bc9301d084222915283c63e3a4e9c P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:27.558739 2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1dbf6dbef74400d9c54d1bc44333982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.559486 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1dbf6dbef74400d9c54d1bc44333982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.560110 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1dbf6dbef74400d9c54d1bc44333982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.562080 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42ebee0a393495ba5e792b81938b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.565795 3752 tablet_replica.cc:333] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:27.566087 3752 raft_consensus.cc:2243] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.566322 3752 raft_consensus.cc:2272] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.567233 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42ebee0a393495ba5e792b81938b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.567654 2812 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet e69bc9301d084222915283c63e3a4e9c (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]) successfully deleted
I20260924 02:04:27.567778 3730 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.570376 3752 ts_tablet_manager.cc:1916] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.572073 3730 tablet_bootstrap.cc:654] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.576287 3751 tablet_replica.cc:333] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:27.576637 3751 raft_consensus.cc:2243] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.576859 3751 raft_consensus.cc:2272] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.577682 3751 ts_tablet_manager.cc:1916] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.579694 2813 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet e69bc9301d084222915283c63e3a4e9c (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]) successfully deleted
I20260924 02:04:27.585319 3730 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.585541 3730 ts_tablet_manager.cc:1403] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.007s
I20260924 02:04:27.587265 3730 raft_consensus.cc:359] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.587489 3730 raft_consensus.cc:385] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.587556 3730 raft_consensus.cc:740] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.587877 3730 consensus_queue.cc:260] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.592089 3730 ts_tablet_manager.cc:1434] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260924 02:04:27.595175 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.595175 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.595680 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0a9028ad343b8aa431e1cc921c3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.599681 3750 tablet_replica.cc:333] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:27.599964 3750 raft_consensus.cc:2243] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:27.600376 3750 raft_consensus.cc:2272] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.601157 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (DEFAULT_TABLE table=default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.601565 3750 ts_tablet_manager.cc:1916] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.601668 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0a9028ad343b8aa431e1cc921c3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.604127 2811 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet e69bc9301d084222915283c63e3a4e9c (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]) successfully deleted
I20260924 02:04:27.614163 3726 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:27.616122 3726 tablet_bootstrap.cc:654] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.622233 3731 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.624964 3731 tablet_bootstrap.cc:654] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.636593 3726 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:27.636790 3726 ts_tablet_manager.cc:1403] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20260924 02:04:27.637637 3726 raft_consensus.cc:359] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.637878 3726 raft_consensus.cc:385] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.637974 3726 raft_consensus.cc:740] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.638688 3726 consensus_queue.cc:260] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.639243 3692 raft_consensus.cc:493] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:27.639418 3692 raft_consensus.cc:515] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.640219 3692 leader_election.cc:290] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:27.640937 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42ebee0a393495ba5e792b81938b516" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
W20260924 02:04:27.641950 3090 leader_election.cc:343] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:27.642365 3731 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.642534 3731 ts_tablet_manager.cc:1403] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.004s
I20260924 02:04:27.643494 3731 raft_consensus.cc:359] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.643733 3731 raft_consensus.cc:385] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.643841 3731 raft_consensus.cc:740] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.644500 3731 consensus_queue.cc:260] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.644735 3726 ts_tablet_manager.cc:1434] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260924 02:04:27.644948 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42ebee0a393495ba5e792b81938b516" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:27.645079 3726 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:27.645181 3294 raft_consensus.cc:2468] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:27.645284 3731 ts_tablet_manager.cc:1434] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 02:04:27.647192 3731 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.647324 3726 tablet_bootstrap.cc:654] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.648641 3092 leader_election.cc:304] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters: d9543f73523d42ad9995f4ac079044b5
I20260924 02:04:27.649398 3731 tablet_bootstrap.cc:654] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.651901 3692 raft_consensus.cc:2804] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:27.652078 3692 raft_consensus.cc:493] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:27.652206 3692 raft_consensus.cc:3060] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.656715 3726 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:27.657099 3726 ts_tablet_manager.cc:1403] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260924 02:04:27.657336 3731 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.657538 3731 ts_tablet_manager.cc:1403] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260924 02:04:27.658774 3726 raft_consensus.cc:359] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.658759 3731 raft_consensus.cc:359] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.659036 3731 raft_consensus.cc:385] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.659030 3726 raft_consensus.cc:385] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.659135 3731 raft_consensus.cc:740] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.659134 3726 raft_consensus.cc:740] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.659480 3731 consensus_queue.cc:260] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.659541 3726 consensus_queue.cc:260] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.660192 3731 ts_tablet_manager.cc:1434] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 02:04:27.660583 3731 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.661158 3726 ts_tablet_manager.cc:1434] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260924 02:04:27.661547 3726 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:27.663894 3726 tablet_bootstrap.cc:654] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.674256 3726 tablet_bootstrap.cc:492] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:27.674464 3726 ts_tablet_manager.cc:1403] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260924 02:04:27.675473 3726 raft_consensus.cc:359] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.675694 3726 raft_consensus.cc:385] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.675788 3726 raft_consensus.cc:740] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.676096 3726 consensus_queue.cc:260] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.677125 3731 tablet_bootstrap.cc:654] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.678246 3726 ts_tablet_manager.cc:1434] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260924 02:04:27.678995 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0a9028ad343b8aa431e1cc921c3f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.686591 2756 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:27.687378 2756 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52768 (request call id 27) took 4482 ms. Trace:
I20260924 02:04:27.687752 2756 rpcz_store.cc:276] 0924 02:04:23.205096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.541810 (+1336714us) service_pool.cc:224] Handling call
0924 02:04:25.693350 (+1151540us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:27.687335 (+1993985us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1380643,"Hive Metastore.run_cpu_time_us":270,"Hive Metastore.run_wall_time_us":592920}
I20260924 02:04:27.708033 3731 tablet_bootstrap.cc:492] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.708235 3731 ts_tablet_manager.cc:1403] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.001s
I20260924 02:04:27.709643 3731 raft_consensus.cc:359] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.709860 3731 raft_consensus.cc:385] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.709944 3731 raft_consensus.cc:740] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.710191 3731 consensus_queue.cc:260] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.715729 3731 ts_tablet_manager.cc:1434] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260924 02:04:27.756163 2367 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu pid 3419
I20260924 02:04:27.756711 3692 raft_consensus.cc:515] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.756822 3751 ts_tablet_manager.cc:1929] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.757012 3751 log.cc:1199] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/d12d26db47694d7387bc01063f987fd6
I20260924 02:04:27.757481 3751 ts_tablet_manager.cc:1950] T d12d26db47694d7387bc01063f987fd6 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:27.757762 3692 leader_election.cc:290] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:27.758262 3752 ts_tablet_manager.cc:1929] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.758457 3752 log.cc:1199] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/d12d26db47694d7387bc01063f987fd6
I20260924 02:04:27.758740 3751 tablet_replica.cc:333] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:27.758980 3751 raft_consensus.cc:2243] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.759197 3751 raft_consensus.cc:2272] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.759866 3751 ts_tablet_manager.cc:1916] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.760318 3730 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.761279 2813 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet d12d26db47694d7387bc01063f987fd6 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]) successfully deleted
I20260924 02:04:27.763329 3750 ts_tablet_manager.cc:1929] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.763495 3750 log.cc:1199] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/d12d26db47694d7387bc01063f987fd6
I20260924 02:04:27.764017 3750 ts_tablet_manager.cc:1950] T d12d26db47694d7387bc01063f987fd6 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:27.765390 3750 tablet_replica.cc:333] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:27.765697 3750 raft_consensus.cc:2243] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:27.766836 2822 catalog_manager.cc:2213] created HMS catalog entry for table [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:27.766991 3752 ts_tablet_manager.cc:1950] T d12d26db47694d7387bc01063f987fd6 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:27.766928 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42ebee0a393495ba5e792b81938b516" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:27.767217 3294 raft_consensus.cc:3060] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.768371 3752 tablet_replica.cc:333] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:27.768638 3752 raft_consensus.cc:2243] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.768858 3752 raft_consensus.cc:2272] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.769472 2811 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet d12d26db47694d7387bc01063f987fd6 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]) successfully deleted
I20260924 02:04:27.769763 3752 ts_tablet_manager.cc:1916] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.770236 3294 raft_consensus.cc:2468] T d42ebee0a393495ba5e792b81938b516 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:27.771545 3092 leader_election.cc:304] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:27.771858 3692 raft_consensus.cc:2804] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:27.772032 3692 raft_consensus.cc:697] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:27.772337 3692 consensus_queue.cc:237] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:27.772742 2812 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet d12d26db47694d7387bc01063f987fd6 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]) successfully deleted
I20260924 02:04:27.777614 2822 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40094 (request call id 9) took 2058 ms. Trace:
I20260924 02:04:27.777798 2822 rpcz_store.cc:276] 0924 02:04:25.718903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:25.719032 (+ 129us) service_pool.cc:224] Handling call
0924 02:04:25.722591 (+ 3559us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x616000051a54. stack: 00007ff165b925c6 00007ff165b92380 00007ff164b9a34d 00000000009a4cb4 00000000009a4c7d 00007ff17510c65d 00007ff17510c753 00007ff171c89db1 00007ff179a78acd 00007ff179c07ef3 00007ff1705d8d16 00007ff1705d8a45 00007ff16ccdc63e 00007ff16ccdb51e 00007ff16cce1758 00007ff16cce20bf
0924 02:04:25.901957 (+179366us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:25.902532 (+ 575us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:27.766784 (+1864252us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:27.777120 (+ 10336us) catalog_manager.cc:2246] Wrote table and tablets to system table
0924 02:04:27.777376 (+ 256us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0924 02:04:27.777556 (+ 180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.767736 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0924 02:04:27.767876 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0924 02:04:27.767883 (+ 7us) write_op.cc:435] Acquired schema lock
0924 02:04:27.767887 (+ 4us) tablet.cc:662] Decoding operations
0924 02:04:27.768001 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0924 02:04:27.768019 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0924 02:04:27.768024 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0924 02:04:27.768120 (+ 96us) tablet.cc:701] Row locks acquired
0924 02:04:27.768122 (+ 2us) write_op.cc:260] PREPARE: finished
0924 02:04:27.768166 (+ 44us) write_op.cc:270] Start()
0924 02:04:27.768211 (+ 45us) write_op.cc:276] Timestamp: P: 1790215467768149 usec, L: 0
0924 02:04:27.768215 (+ 4us) op_driver.cc:348] REPLICATION: starting
0924 02:04:27.768439 (+ 224us) log.cc:844] Serialized 432 byte log entry
0924 02:04:27.775419 (+ 6980us) op_driver.cc:464] REPLICATION: finished
0924 02:04:27.775563 (+ 144us) write_op.cc:301] APPLY: starting
0924 02:04:27.775606 (+ 43us) tablet.cc:1394] starting BulkCheckPresence
0924 02:04:27.775658 (+ 52us) tablet.cc:1397] finished BulkCheckPresence
0924 02:04:27.775717 (+ 59us) tablet.cc:1399] starting ApplyRowOperation cycle
0924 02:04:27.775884 (+ 167us) tablet.cc:1410] finished ApplyRowOperation cycle
0924 02:04:27.775927 (+ 43us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0924 02:04:27.775935 (+ 8us) write_op.cc:312] APPLY: finished
0924 02:04:27.776038 (+ 103us) log.cc:844] Serialized 28 byte log entry
0924 02:04:27.776131 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.776159 (+ 28us) write_op.cc:454] Released schema lock
0924 02:04:27.776172 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0924 02:04:27.776281 (+ 109us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.776285 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1559748,"Hive Metastore.run_cpu_time_us":398,"Hive Metastore.run_wall_time_us":303870,"spinlock_wait_cycles":5903360,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":705,"apply.run_wall_time_us":704,"num_ops":2,"prepare.queue_time_us":78,"prepare.run_cpu_time_us":850,"prepare.run_wall_time_us":850,"raft.queue_time_us":599,"raft.run_cpu_time_us":642,"raft.run_wall_time_us":642,"replication_time_us":7159}]]}
I20260924 02:04:27.779102 3730 tablet_bootstrap.cc:654] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.785420 3730 tablet_bootstrap.cc:492] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.785620 3730 ts_tablet_manager.cc:1403] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.004s
I20260924 02:04:27.787070 3730 raft_consensus.cc:359] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.787309 3730 raft_consensus.cc:385] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.787413 3730 raft_consensus.cc:740] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.787724 3730 consensus_queue.cc:260] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.766176 3750 raft_consensus.cc:2272] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.788434 3730 ts_tablet_manager.cc:1434] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 02:04:27.771458 3569 raft_consensus.cc:493] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:27.789160 3750 ts_tablet_manager.cc:1916] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.789184 3569 raft_consensus.cc:515] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.789876 3569 leader_election.cc:290] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.771687 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42ebee0a393495ba5e792b81938b516" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:27.790524 3018 raft_consensus.cc:3060] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.792562 3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1dbf6dbef74400d9c54d1bc44333982" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:27.792837 3294 raft_consensus.cc:2468] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:27.795497 2953 leader_election.cc:304] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:27.796208 3569 raft_consensus.cc:2804] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:27.796322 3569 raft_consensus.cc:493] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:27.796418 3569 raft_consensus.cc:3060] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.796808 3018 raft_consensus.cc:2468] T d42ebee0a393495ba5e792b81938b516 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
F20260924 02:04:27.799773 2902 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 10 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260924 02:04:27.800969 3751 ts_tablet_manager.cc:1929] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.801112 3751 log.cc:1199] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/0a0e19bdca93403c8bb502ba377fac75
I20260924 02:04:27.801579 3751 ts_tablet_manager.cc:1950] T 0a0e19bdca93403c8bb502ba377fac75 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
@ 0x7ff162e68d5d google::LogMessage::Fail() at ??:0
I20260924 02:04:27.803206 3751 tablet_replica.cc:333] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:27.803479 3751 raft_consensus.cc:2243] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:27.803687 2813 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 0a0e19bdca93403c8bb502ba377fac75 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]) successfully deleted
I20260924 02:04:27.804062 3751 raft_consensus.cc:2272] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.804736 3751 ts_tablet_manager.cc:1916] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.804875 3752 ts_tablet_manager.cc:1929] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.805022 3752 log.cc:1199] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/0a0e19bdca93403c8bb502ba377fac75
I20260924 02:04:27.805480 3752 ts_tablet_manager.cc:1950] T 0a0e19bdca93403c8bb502ba377fac75 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:27.809036 2748 catalog_manager.cc:2770] deleted HMS catalog entry for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:27.809650 2748 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52768 (request call id 32) took 4436 ms. Trace:
I20260924 02:04:27.809765 2748 rpcz_store.cc:276] 0924 02:04:23.372749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.788440 (+1415691us) service_pool.cc:224] Handling call
0924 02:04:25.693573 (+905133us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0924 02:04:27.809584 (+2116011us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1973466,"Hive Metastore.run_cpu_time_us":276,"Hive Metastore.run_wall_time_us":141569}
I20260924 02:04:27.813712 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 008867a4d35a44e694f3c54334cb8426 (DEFAULT_TABLE table=default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.814488 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008867a4d35a44e694f3c54334cb8426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.816346 2822 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "default.Table_ca026bc3ca2044659a0f0d9a2a3fa7c0" } new_table_name: "default.Table_0693b1cf142145dc9afb7a130116f455" modify_external_catalogs: true
I20260924 02:04:27.820154 3750 ts_tablet_manager.cc:1929] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.820315 3750 log.cc:1199] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/0a0e19bdca93403c8bb502ba377fac75
I20260924 02:04:27.820763 3750 ts_tablet_manager.cc:1950] T 0a0e19bdca93403c8bb502ba377fac75 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:27.821951 3750 tablet_replica.cc:333] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:27.822726 3750 raft_consensus.cc:2243] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.822939 3750 raft_consensus.cc:2272] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.823369 3752 tablet_replica.cc:333] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:27.823498 2812 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet 0a0e19bdca93403c8bb502ba377fac75 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]) successfully deleted
I20260924 02:04:27.823617 3752 raft_consensus.cc:2243] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:27.823810 3752 raft_consensus.cc:2272] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:27.824287 3750 ts_tablet_manager.cc:1916] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.824429 3752 ts_tablet_manager.cc:1916] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:27.827291 3569 raft_consensus.cc:515] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.830030 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 008867a4d35a44e694f3c54334cb8426 (DEFAULT_TABLE table=default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.830622 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008867a4d35a44e694f3c54334cb8426. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff162e6cb23 google::LogMessage::SendToLog() at ??:0
I20260924 02:04:27.837007 3615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 02:04:27.838645 3730 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:27.838925 3569 leader_election.cc:290] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.840624 3730 tablet_bootstrap.cc:654] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.842284 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1dbf6dbef74400d9c54d1bc44333982" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:27.842530 3296 raft_consensus.cc:3060] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.845606 3296 raft_consensus.cc:2468] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
@ 0x7ff162e6875c google::LogMessage::Flush() at ??:0
I20260924 02:04:27.846330 2953 leader_election.cc:304] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
@ 0x7ff162e689a1 google::LogMessage::~LogMessage() at ??:0
I20260924 02:04:27.848981 3569 raft_consensus.cc:2804] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:27.849210 3569 raft_consensus.cc:697] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:27.849557 3569 consensus_queue.cc:237] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.854296 3731 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:27.856660 3731 tablet_bootstrap.cc:654] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.862226 3750 ts_tablet_manager.cc:1929] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.862428 3750 log.cc:1199] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/dc9c9a9031cb48c3a7844134859b347b
I20260924 02:04:27.862892 3750 ts_tablet_manager.cc:1950] T dc9c9a9031cb48c3a7844134859b347b P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:27.864781 3730 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:27.865031 3730 ts_tablet_manager.cc:1403] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.004s
I20260924 02:04:27.865769 3752 ts_tablet_manager.cc:1929] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.865963 3752 log.cc:1199] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/dc9c9a9031cb48c3a7844134859b347b
I20260924 02:04:27.866214 3730 raft_consensus.cc:359] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.866434 3752 ts_tablet_manager.cc:1950] T dc9c9a9031cb48c3a7844134859b347b P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:27.866492 3730 raft_consensus.cc:385] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.866588 3730 raft_consensus.cc:740] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.866897 3730 consensus_queue.cc:260] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.867939 3751 ts_tablet_manager.cc:1929] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:27.868111 3751 log.cc:1199] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/dc9c9a9031cb48c3a7844134859b347b
I20260924 02:04:27.869155 3751 ts_tablet_manager.cc:1950] T dc9c9a9031cb48c3a7844134859b347b P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:27.870783 2813 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet dc9c9a9031cb48c3a7844134859b347b (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]) successfully deleted
@ 0x7ff179b62344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260924 02:04:27.879556 3730 ts_tablet_manager.cc:1434] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260924 02:04:27.880544 2812 catalog_manager.cc:5063] TS c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): tablet dc9c9a9031cb48c3a7844134859b347b (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]) successfully deleted
@ 0x7ff179b60bf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7ff179b6886c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260924 02:04:27.880446 3731 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:27.901873 3731 ts_tablet_manager.cc:1403] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.010s
@ 0x7ff179b686e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260924 02:04:27.903136 3731 raft_consensus.cc:359] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.903440 3731 raft_consensus.cc:385] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.903537 3731 raft_consensus.cc:740] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.904175 3731 consensus_queue.cc:260] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
@ 0xaaef9d std::function<>::operator()() at ??:?
I20260924 02:04:27.905524 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1dbf6dbef74400d9c54d1bc44333982" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:27.905812 3156 raft_consensus.cc:2468] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:27.906661 2811 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 0a0e19bdca93403c8bb502ba377fac75 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]) successfully deleted
I20260924 02:04:27.907923 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1dbf6dbef74400d9c54d1bc44333982" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:27.908201 3156 raft_consensus.cc:3060] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7ff165bb8079 kudu::Thread::SuperviseThread() at ??:0
I20260924 02:04:27.911659 2827 catalog_manager.cc:2213] created HMS catalog entry for table [id=6dc4ff1146624ae3a6eade6146bc887b]
@ 0x7ff16928e6db start_thread at ??:0
@ 0x7ff161d1561f clone at ??:0
I20260924 02:04:27.916939 3156 raft_consensus.cc:2468] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:27.918278 2753 catalog_manager.cc:2213] created HMS catalog entry for table [id=cb369bd813d840638d22e8f9197908c7]
W20260924 02:04:27.919231 2753 catalog_manager.cc:2241] Illegal state: an error occurred while writing to the sys-catalog: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER
I20260924 02:04:27.920323 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 008867a4d35a44e694f3c54334cb8426 (DEFAULT_TABLE table=default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:27.921098 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008867a4d35a44e694f3c54334cb8426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:27.931344 3569 raft_consensus.cc:493] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:27.931542 3569 raft_consensus.cc:515] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.935777 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0a9028ad343b8aa431e1cc921c3f5" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:27.936141 3296 raft_consensus.cc:2468] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:27.937029 2953 leader_election.cc:304] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:27.937474 3768 raft_consensus.cc:2804] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:27.937582 3768 raft_consensus.cc:493] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:27.937736 3768 raft_consensus.cc:3060] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.942557 3768 raft_consensus.cc:515] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.944974 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0a9028ad343b8aa431e1cc921c3f5" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:27.945384 3296 raft_consensus.cc:3060] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.949281 3296 raft_consensus.cc:2468] T 8fb0a9028ad343b8aa431e1cc921c3f5 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:27.950093 2953 leader_election.cc:304] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:27.951215 3774 raft_consensus.cc:2804] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:27.951380 3774 raft_consensus.cc:697] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:27.951694 3774 consensus_queue.cc:237] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.951905 3768 leader_election.cc:290] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.954095 3569 leader_election.cc:290] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:27.956509 3731 ts_tablet_manager.cc:1434] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
I20260924 02:04:27.956696 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0a9028ad343b8aa431e1cc921c3f5" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:27.956918 3156 raft_consensus.cc:3060] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:27.959911 3156 raft_consensus.cc:2468] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:27.960806 3726 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:27.960873 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0a9028ad343b8aa431e1cc921c3f5" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:27.961063 3156 raft_consensus.cc:2376] T 8fb0a9028ad343b8aa431e1cc921c3f5 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1. Re-sending same reply.
I20260924 02:04:27.963413 3726 tablet_bootstrap.cc:654] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:27.972308 3726 tablet_bootstrap.cc:492] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:27.972506 3726 ts_tablet_manager.cc:1403] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20260924 02:04:27.975365 3726 raft_consensus.cc:359] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.975606 3726 raft_consensus.cc:385] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:27.975677 3726 raft_consensus.cc:740] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:27.976013 3726 consensus_queue.cc:260] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:27.976573 3726 ts_tablet_manager.cc:1434] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260924 02:04:28.026427 2753 catalog_manager.cc:2223] deleted orphaned HMS catalog entry for table [id=cb369bd813d840638d22e8f9197908c7]
I20260924 02:04:28.026872 2753 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52768 (request call id 33) took 4621 ms. Trace:
I20260924 02:04:28.027071 2753 rpcz_store.cc:276] 0924 02:04:23.404982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0924 02:04:24.801079 (+1396097us) service_pool.cc:224] Handling call
0924 02:04:25.698449 (+897370us) catalog_manager.cc:2140] Acquired catalog manager lock
0924 02:04:25.698986 (+ 537us) catalog_manager.cc:2186] Created new table and tablet info
0924 02:04:27.918212 (+2219226us) catalog_manager.cc:2212] Created new table in HMS catalog
0924 02:04:27.919095 (+ 883us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.919098 (+ 3us) write_op.cc:454] Released schema lock
0924 02:04:27.919346 (+ 248us) catalog_manager.cc:2220] Rolling back HMS table creation
0924 02:04:28.026798 (+107452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0924 02:04:27.918992 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 23f4e9ecc0904d0ba15506c5c2206881 is not leader of this config: current role FOLLOWER)
0924 02:04:27.919022 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
0924 02:04:27.919029 (+ 7us) write_op.cc:454] Released schema lock
0924 02:04:27.919033 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":2109710,"Hive Metastore.run_cpu_time_us":559,"Hive Metastore.run_wall_time_us":216075,"child_traces":[["op",{}]]}
W20260924 02:04:28.028338 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:28.135617 3692 raft_consensus.cc:493] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:28.135874 3692 raft_consensus.cc:515] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:28.136762 3692 leader_election.cc:290] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:28.137737 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab1d437fd4456a939b52c636395722" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:28.138047 3018 raft_consensus.cc:2468] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:28.139202 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab1d437fd4456a939b52c636395722" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:28.139474 3296 raft_consensus.cc:2468] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:28.140287 3090 leader_election.cc:304] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:28.141067 3692 raft_consensus.cc:2804] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:28.141211 3692 raft_consensus.cc:493] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:28.141301 3692 raft_consensus.cc:3060] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.145632 3692 raft_consensus.cc:515] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:28.147755 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab1d437fd4456a939b52c636395722" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:28.148096 3018 raft_consensus.cc:3060] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.152209 3018 raft_consensus.cc:2468] T a2ab1d437fd4456a939b52c636395722 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:28.153488 3090 leader_election.cc:304] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:28.153976 3736 raft_consensus.cc:2804] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:28.159148 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab1d437fd4456a939b52c636395722" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:28.159443 3296 raft_consensus.cc:3060] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.162878 3296 raft_consensus.cc:2468] T a2ab1d437fd4456a939b52c636395722 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:28.165022 3692 leader_election.cc:290] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:28.173223 3736 raft_consensus.cc:697] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:28.173763 3736 consensus_queue.cc:237] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:28.181630 2367 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu with pid 3419
I20260924 02:04:28.185290 3789 raft_consensus.cc:493] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:28.185907 3789 raft_consensus.cc:515] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:28.187414 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008867a4d35a44e694f3c54334cb8426" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:28.187650 3018 raft_consensus.cc:2468] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:28.188280 3090 leader_election.cc:304] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:28.188627 3692 raft_consensus.cc:2804] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:28.188715 3692 raft_consensus.cc:493] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:28.188813 3692 raft_consensus.cc:3060] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.192343 3692 raft_consensus.cc:515] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:28.196547 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008867a4d35a44e694f3c54334cb8426" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:28.196851 3018 raft_consensus.cc:3060] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.200035 3018 raft_consensus.cc:2468] T 008867a4d35a44e694f3c54334cb8426 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:28.201093 3090 leader_election.cc:304] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:28.202683 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008867a4d35a44e694f3c54334cb8426" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:28.202972 3296 raft_consensus.cc:3060] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:28.206357 3296 raft_consensus.cc:2468] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:28.207703 3792 raft_consensus.cc:2804] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:28.211018 3692 leader_election.cc:290] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:28.215344 3792 raft_consensus.cc:697] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:28.215117 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008867a4d35a44e694f3c54334cb8426" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:28.215734 3792 consensus_queue.cc:237] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } }
I20260924 02:04:28.216102 3296 raft_consensus.cc:2376] T 008867a4d35a44e694f3c54334cb8426 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1. Re-sending same reply.
I20260924 02:04:28.216826 3789 leader_election.cc:290] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
W20260924 02:04:28.225857 3093 connection.cc:573] client connection to 127.2.79.254:45523 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:28.229550 3795 negotiation.cc:336] Failed RPC negotiation. Trace:
0924 02:04:28.227265 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.79.254:45523 (local address 127.2.79.194:48919)
0924 02:04:28.227923 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0924 02:04:28.228082 (+ 159us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":344,"threads_started":1}
I20260924 02:04:28.265488 3741 consensus_queue.cc:1048] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.273804 3797 consensus_queue.cc:1048] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 02:04:28.329733 2952 connection.cc:573] server connection from 127.0.0.1:36600 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:28.329867 3353 connection.cc:573] client connection to 127.2.79.252:44061 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:28.330729 3353 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.252:44061)
W20260924 02:04:28.331321 3353 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.252:44061)
W20260924 02:04:28.331322 2741 connection.cc:573] server connection from 127.0.0.1:52756 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:28.332077 3353 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:28.416744 3808 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:28.417054 3808 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:28.417987 3808 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:28.420487 2743 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:28.420771 2742 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:28.420892 2742 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:28.421360 3808 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260924 02:04:28.760991 3792 consensus_queue.cc:1048] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.770834 3813 consensus_queue.cc:1048] T d42ebee0a393495ba5e792b81938b516 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.887168 3774 consensus_queue.cc:1048] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.895470 3774 consensus_queue.cc:1048] T 8fb0a9028ad343b8aa431e1cc921c3f5 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.924012 3774 consensus_queue.cc:1048] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:28.933895 3822 consensus_queue.cc:1048] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:29.008665 3828 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:29.008961 3828 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.009693 3828 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:29.010936 2742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260924 02:04:29.012645 2743 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:29.012827 2742 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:29.013013 2742 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:29.013387 3828 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260924 02:04:29.072990 3813 consensus_queue.cc:1048] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:29.080312 3813 consensus_queue.cc:1048] T a2ab1d437fd4456a939b52c636395722 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:29.175323 3813 consensus_queue.cc:1048] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:29.181581 3815 consensus_queue.cc:1048] T 008867a4d35a44e694f3c54334cb8426 P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:29.185456 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--webserver_interface=127.2.79.254
--webserver_port=39869
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260924 02:04:29.572986 3836 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:29.573367 3836 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:29.573444 3836 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:29.582720 3836 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:29.582870 3836 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:29.582973 3836 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:29.583047 3836 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:29.594872 3836 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.79.254
--webserver_port=39869
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:29.596691 3836 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:29.598704 3836 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:29.608078 3844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:29.608100 3843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:29.608044 3846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:29.609128 3836 server_base.cc:1061] running on GCE node
I20260924 02:04:29.610004 3836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:29.611728 3836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:29.613039 3836 hybrid_clock.cc:648] HybridClock initialized: now 1790215469612998 us; error 33 us; skew 500 ppm
I20260924 02:04:29.613433 3836 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:29.616339 3836 webserver.cc:533] Webserver started at http://127.2.79.254:39869/ using document root <none> and password file <none>
I20260924 02:04:29.617200 3836 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:29.617362 3836 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:29.624768 3836 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260924 02:04:29.628949 3852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:29.631491 3836 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260924 02:04:29.631754 3836 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:29.632887 3836 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:29.647871 3836 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:29.648903 3836 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:29.649250 3836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:29.674695 3836 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.254:45523
I20260924 02:04:29.674710 3903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.254:45523 every 8 connection(s)
I20260924 02:04:29.676652 3836 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
I20260924 02:04:29.679260 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 3836
I20260924 02:04:29.711485 3904 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:29.724023 3904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap starting.
I20260924 02:04:29.731514 3203 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:29.733187 3064 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:29.748978 3904 log.cc:826] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:29.818776 3904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap replayed 1/1 log segments. Stats: ops{read=79 overwritten=0 applied=79 ignored=0} inserts{seen=50 ignored=0} mutations{seen=66 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:29.819540 3904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap complete.
I20260924 02:04:29.820601 3919 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:29.820900 3919 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.821843 3919 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:29.826097 2742 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:29.828368 3904 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.829555 3904 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b31e7e4c8ff4e30980f19a91551e618, State: Initialized, Role: FOLLOWER
I20260924 02:04:29.830564 3904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 79, Last appended: 2.79, Last appended by leader: 79, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.831671 3923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:29.832059 3923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:29.833597 3904 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:29.833619 3879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 3 candidate_status { last_received { term: 2 index: 80 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:29.834385 3879 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 2.
I20260924 02:04:29.835378 2743 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:29.835817 3919 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260924 02:04:29.836004 3919 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2629a26254094afb829bb3ca8fa2c593)
I20260924 02:04:29.836117 3919 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 2 FOLLOWER]: Advancing to term 3
I20260924 02:04:29.840127 3919 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.841077 3919 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:29.843495 3879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 3 candidate_status { last_received { term: 2 index: 80 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618"
I20260924 02:04:29.843834 3879 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 2 FOLLOWER]: Advancing to term 3
W20260924 02:04:29.845177 2742 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:29.851991 3879 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 3.
I20260924 02:04:29.852689 2743 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:29.853145 3919 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Leader election won for term 3
I20260924 02:04:29.853854 3919 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 LEADER]: Becoming Leader. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Running, Role: LEADER
I20260924 02:04:29.854485 3919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 2.80, Last appended by leader: 80, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:29.856922 3936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 3 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:29.857424 3936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:29.871626 3939 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:29.871858 3939 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: loading cluster ID for follower catalog manager: success
I20260924 02:04:29.877218 3939 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: acquiring CA information for follower catalog manager: success
I20260924 02:04:29.881628 3939 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:29.904227 3836 master_runner.cc:187] Error getting master registration for 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111),
I20260924 02:04:29.908407 3836 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:29.974923 3342 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:29.979526 3869 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:41089; Asking this server to re-register.
I20260924 02:04:29.981006 3342 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:29.984938 3869 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.211781 3869 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:37921; Asking this server to re-register.
I20260924 02:04:30.212563 3203 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:30.214987 3869 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
W20260924 02:04:30.236208 2742 consensus_peers.cc:597] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 -> Peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Couldn't send request to peer 2629a26254094afb829bb3ca8fa2c593. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 02:04:30.308169 3868 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:57575; Asking this server to re-register.
I20260924 02:04:30.309088 3064 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:30.311307 3868 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:30.447680 3949 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:30.447975 3949 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:30.450301 3949 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:30.450785 2766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 4 candidate_status { last_received { term: 2 index: 79 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
W20260924 02:04:30.451907 3855 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:30.454028 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:30.454263 3855 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:30.454820 3949 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260924 02:04:30.456646 3879 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Refusing update from remote peer 23f4e9ecc0904d0ba15506c5c2206881: Log matching property violated. Preceding OpId in replica: term: 2 index: 79. Preceding OpId from leader: term: 3 index: 81. (index mismatch)
I20260924 02:04:30.457701 3936 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 79, Time since last communication: 0.000s
I20260924 02:04:30.464568 3949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 3 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:30.464872 3949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:30.467025 3936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:30.467514 3936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:30.468966 3949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:30.469214 3949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:30.504257 3940 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:30.506739 3940 catalog_manager.cc:692] Loaded metadata for table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:30.507202 3940 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:30.507511 3940 catalog_manager.cc:692] Loaded metadata for table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:30.507786 3940 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:30.508040 3940 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:30.508342 3940 catalog_manager.cc:692] Loaded metadata for table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]
I20260924 02:04:30.508605 3940 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:30.508862 3940 catalog_manager.cc:692] Loaded metadata for table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:30.509119 3940 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:30.509423 3940 catalog_manager.cc:692] Loaded metadata for table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:30.509673 3940 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:30.509923 3940 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:30.510164 3940 catalog_manager.cc:692] Loaded metadata for table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:30.510428 3940 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:30.510694 3940 catalog_manager.cc:692] Loaded metadata for table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:30.512449 3940 tablet_loader.cc:96] loaded metadata for tablet 008867a4d35a44e694f3c54334cb8426 (table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419])
I20260924 02:04:30.512718 3940 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:30.513113 3940 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:30.513643 3940 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:30.513881 3940 tablet_loader.cc:96] loaded metadata for tablet 47ee2924ddec4843bbd9b17eea0024cf (table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b])
I20260924 02:04:30.514117 3940 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:30.514534 3940 tablet_loader.cc:96] loaded metadata for tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:30.514765 3940 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:30.515333 3940 tablet_loader.cc:96] loaded metadata for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:30.515883 3940 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:30.516127 3940 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:30.516379 3940 tablet_loader.cc:96] loaded metadata for tablet a2ab1d437fd4456a939b52c636395722 (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:30.516628 3940 tablet_loader.cc:96] loaded metadata for tablet ae040db05d8b477392beb0d413e25b5f (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a])
I20260924 02:04:30.517172 3940 tablet_loader.cc:96] loaded metadata for tablet d42ebee0a393495ba5e792b81938b516 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:30.517581 3940 tablet_loader.cc:96] loaded metadata for tablet e1dbf6dbef74400d9c54d1bc44333982 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:30.518211 3940 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:30.519542 3940 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:30.519623 3940 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:30.521297 3940 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:30.522265 3940 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Loaded TSK: 0
I20260924 02:04:30.522912 3940 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:30.523921 3940 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:30.524932 3940 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 20
I20260924 02:04:30.570096 2756 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_a03adf7b11ae4b39ac0273d0e3cf5142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.570580 2752 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_3c5dbb4d423945049a0ff011434aea7f" } modify_external_catalogs: true
I20260924 02:04:30.570734 2755 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_e6a5702bf6ca46bb8828000eca4e6ab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.570829 2752 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_3c5dbb4d423945049a0ff011434aea7f" } modify_external_catalogs: true
I20260924 02:04:30.571494 2749 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_f9050bc88b744848bdda785ead091fe3" } modify_external_catalogs: true
I20260924 02:04:30.571699 2749 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_f9050bc88b744848bdda785ead091fe3" } modify_external_catalogs: true
I20260924 02:04:30.571837 2753 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_907164ea3ff94d82b3bcf3280de38fbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.572158 2750 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_da49dc787bc94e6f99faf522e45a9529"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.571437 2748 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_65af2e2ad1fa42629241f4230f5ca9c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.572235 2754 master_service.cc:960] ReplaceTablet: received request to replace tablet 711a7b2e55214fd0a7849d997ebfcf92 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:30.572470 2747 master_service.cc:960] ReplaceTablet: received request to replace tablet 711a7b2e55214fd0a7849d997ebfcf92 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:30.572728 2751 master_service.cc:960] ReplaceTablet: received request to replace tablet e1dbf6dbef74400d9c54d1bc44333982 from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:30.582065 2754 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 711a7b2e55214fd0a7849d997ebfcf92
I20260924 02:04:30.582718 2754 catalog_manager.cc:6934] ReplaceTablet: tablet 711a7b2e55214fd0a7849d997ebfcf92 deleted and replaced by tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54
I20260924 02:04:30.583066 2754 master_service.cc:960] ReplaceTablet: received request to replace tablet ae040db05d8b477392beb0d413e25b5f from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:30.583316 2747 master_service.cc:960] ReplaceTablet: received request to replace tablet ae040db05d8b477392beb0d413e25b5f from {username='slave'} at 127.0.0.1:52768
I20260924 02:04:30.583652 3137 tablet_service.cc:1558] Processing DeleteTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 with delete_type TABLET_DATA_DELETED (replaced by tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:30.585604 3275 tablet_service.cc:1558] Processing DeleteTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 with delete_type TABLET_DATA_DELETED (replaced by tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:30.588176 2751 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet e1dbf6dbef74400d9c54d1bc44333982
I20260924 02:04:30.589972 2751 catalog_manager.cc:6934] ReplaceTablet: tablet e1dbf6dbef74400d9c54d1bc44333982 deleted and replaced by tablet ecb43a38e52a4fe4a457f769d7bd847a
I20260924 02:04:30.590484 2751 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "default.Table_977f2cf6a8ee46e7969fac8820a1a6ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:30.590788 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 with delete_type TABLET_DATA_DELETED (replaced by tablet ecb43a38e52a4fe4a457f769d7bd847a) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:30.591538 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 with delete_type TABLET_DATA_DELETED (replaced by tablet ecb43a38e52a4fe4a457f769d7bd847a) from {username='slave'} at 127.0.0.1:53296
I20260924 02:04:30.594034 2996 tablet_service.cc:1558] Processing DeleteTablet for tablet 711a7b2e55214fd0a7849d997ebfcf92 with delete_type TABLET_DATA_DELETED (replaced by tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:30.594477 2997 tablet_service.cc:1558] Processing DeleteTablet for tablet e1dbf6dbef74400d9c54d1bc44333982 with delete_type TABLET_DATA_DELETED (replaced by tablet ecb43a38e52a4fe4a457f769d7bd847a) from {username='slave'} at 127.0.0.1:49114
F20260924 02:04:30.595584 2920 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 13 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f2d8e352d5d google::LogMessage::Fail() at ??:0
I20260924 02:04:30.600845 2754 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet ae040db05d8b477392beb0d413e25b5f
@ 0x7f2d8e356b23 google::LogMessage::SendToLog() at ??:0
I20260924 02:04:30.601822 2754 catalog_manager.cc:6934] ReplaceTablet: tablet ae040db05d8b477392beb0d413e25b5f deleted and replaced by tablet cf979f356ade4302be6e8bc0d2b3e46e
I20260924 02:04:30.602245 3136 tablet_service.cc:1558] Processing DeleteTablet for tablet ae040db05d8b477392beb0d413e25b5f with delete_type TABLET_DATA_DELETED (replaced by tablet cf979f356ade4302be6e8bc0d2b3e46e) from {username='slave'} at 127.0.0.1:53296
@ 0x7f2d8e35275c google::LogMessage::Flush() at ??:0
I20260924 02:04:30.603223 2997 tablet_service.cc:1558] Processing DeleteTablet for tablet ae040db05d8b477392beb0d413e25b5f with delete_type TABLET_DATA_DELETED (replaced by tablet cf979f356ade4302be6e8bc0d2b3e46e) from {username='slave'} at 127.0.0.1:49114
I20260924 02:04:30.603931 3274 tablet_service.cc:1558] Processing DeleteTablet for tablet ae040db05d8b477392beb0d413e25b5f with delete_type TABLET_DATA_DELETED (replaced by tablet cf979f356ade4302be6e8bc0d2b3e46e) from {username='slave'} at 127.0.0.1:54378
I20260924 02:04:30.605554 3959 tablet_replica.cc:333] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
@ 0x7f2d8e3529a1 google::LogMessage::~LogMessage() at ??:0
I20260924 02:04:30.611781 3959 raft_consensus.cc:2243] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.612089 3960 tablet_replica.cc:333] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:30.612087 3959 raft_consensus.cc:2272] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.612316 3960 raft_consensus.cc:2243] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:30.612692 3960 raft_consensus.cc:2272] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.612807 3959 ts_tablet_manager.cc:1916] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.613307 3960 ts_tablet_manager.cc:1916] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.615535 3958 tablet_replica.cc:333] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:30.615818 3958 raft_consensus.cc:2243] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.616111 3958 raft_consensus.cc:2272] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.616832 3958 ts_tablet_manager.cc:1916] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.621217 3959 ts_tablet_manager.cc:1929] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:30.621397 3959 log.cc:1199] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/711a7b2e55214fd0a7849d997ebfcf92
I20260924 02:04:30.622066 3959 ts_tablet_manager.cc:1950] T 711a7b2e55214fd0a7849d997ebfcf92 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:30.622262 2747 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_2bbb2478ff414d04806f78dccbcabc8c" } new_table_name: "default.Table_1e2b7e9fe77d4e91b084be7959d3fb89" modify_external_catalogs: true
I20260924 02:04:30.623035 2754 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52768:
table { table_name: "default.Table_635d6d13e9ef48aca3c221ede242342e" } new_table_name: "default.Table_fc4bacb12c874dae97a891c69ad096f1" modify_external_catalogs: true
I20260924 02:04:30.623548 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
@ 0x7f2da504c344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260924 02:04:30.630652 3960 ts_tablet_manager.cc:1929] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:30.630836 3960 log.cc:1199] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/711a7b2e55214fd0a7849d997ebfcf92
I20260924 02:04:30.631269 3959 tablet_replica.cc:333] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:30.631645 3959 raft_consensus.cc:2243] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.631896 3959 raft_consensus.cc:2272] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.632112 3960 ts_tablet_manager.cc:1950] T 711a7b2e55214fd0a7849d997ebfcf92 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
@ 0x7f2da504abf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260924 02:04:30.632756 3959 ts_tablet_manager.cc:1916] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.633457 3960 tablet_replica.cc:333] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:30.633703 3960 raft_consensus.cc:2243] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:30.633991 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet 711a7b2e55214fd0a7849d997ebfcf92 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]) successfully deleted
I20260924 02:04:30.634069 3960 raft_consensus.cc:2272] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.634778 3960 ts_tablet_manager.cc:1916] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.636174 3137 tablet_service.cc:1511] Processing CreateTablet for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (DEFAULT_TABLE table=default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.636791 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2da505286c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260924 02:04:30.639467 3136 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee2924ddec4843bbd9b17eea0024cf (DEFAULT_TABLE table=default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.639958 3136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee2924ddec4843bbd9b17eea0024cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.643599 3275 tablet_service.cc:1511] Processing CreateTablet for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (DEFAULT_TABLE table=default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.644173 3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.644568 3960 ts_tablet_manager.cc:1929] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.644730 3960 log.cc:1199] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/e1dbf6dbef74400d9c54d1bc44333982
I20260924 02:04:30.644893 3959 ts_tablet_manager.cc:1929] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.645043 3959 log.cc:1199] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/e1dbf6dbef74400d9c54d1bc44333982
I20260924 02:04:30.645164 3960 ts_tablet_manager.cc:1950] T e1dbf6dbef74400d9c54d1bc44333982 P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
I20260924 02:04:30.645551 3959 ts_tablet_manager.cc:1950] T e1dbf6dbef74400d9c54d1bc44333982 P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:30.646312 3960 tablet_replica.cc:333] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: stopping tablet replica
I20260924 02:04:30.646543 3960 raft_consensus.cc:2243] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.646752 3960 raft_consensus.cc:2272] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.646836 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet e1dbf6dbef74400d9c54d1bc44333982 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]) successfully deleted
I20260924 02:04:30.647408 3960 ts_tablet_manager.cc:1916] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.647382 3274 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee2924ddec4843bbd9b17eea0024cf (DEFAULT_TABLE table=default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f2da50526e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260924 02:04:30.647900 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee2924ddec4843bbd9b17eea0024cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.648518 3959 tablet_replica.cc:333] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: stopping tablet replica
I20260924 02:04:30.648736 3959 raft_consensus.cc:2243] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Raft consensus shutting down.
I20260924 02:04:30.649142 3959 raft_consensus.cc:2272] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.649853 3959 ts_tablet_manager.cc:1916] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.651551 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet e1dbf6dbef74400d9c54d1bc44333982 (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]) successfully deleted
I20260924 02:04:30.651628 2996 tablet_service.cc:1511] Processing CreateTablet for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (DEFAULT_TABLE table=default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.652101 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.657806 3959 ts_tablet_manager.cc:1929] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.657955 3959 log.cc:1199] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-2/wal/wals/ae040db05d8b477392beb0d413e25b5f
I20260924 02:04:30.658370 3959 ts_tablet_manager.cc:1950] T ae040db05d8b477392beb0d413e25b5f P 79827750d7ae4673803de4e9415165e6: Deleting consensus metadata
I20260924 02:04:30.659310 2997 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee2924ddec4843bbd9b17eea0024cf (DEFAULT_TABLE table=default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.659816 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee2924ddec4843bbd9b17eea0024cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.659772 2742 catalog_manager.cc:5063] TS 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): tablet ae040db05d8b477392beb0d413e25b5f (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]) successfully deleted
@ 0xaaef9d std::function<>::operator()() at ??:?
I20260924 02:04:30.663785 3960 ts_tablet_manager.cc:1929] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.663949 3960 log.cc:1199] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-0/wal/wals/ae040db05d8b477392beb0d413e25b5f
I20260924 02:04:30.664433 3960 ts_tablet_manager.cc:1950] T ae040db05d8b477392beb0d413e25b5f P d9543f73523d42ad9995f4ac079044b5: Deleting consensus metadata
@ 0x7f2d910a2079 kudu::Thread::SuperviseThread() at ??:0
I20260924 02:04:30.666079 2740 catalog_manager.cc:5063] TS d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159): tablet ae040db05d8b477392beb0d413e25b5f (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]) successfully deleted
I20260924 02:04:30.671238 3965 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:30.672765 3958 ts_tablet_manager.cc:1929] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 02:04:30.672995 3958 log.cc:1199] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/711a7b2e55214fd0a7849d997ebfcf92
I20260924 02:04:30.673528 3965 tablet_bootstrap.cc:654] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
@ 0x7f2d947786db start_thread at ??:0
I20260924 02:04:30.680464 3965 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:30.680670 3965 ts_tablet_manager.cc:1403] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260924 02:04:30.681520 3965 raft_consensus.cc:359] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.681725 3965 raft_consensus.cc:385] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.681803 3965 raft_consensus.cc:740] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.682058 3965 consensus_queue.cc:260] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.682677 3965 ts_tablet_manager.cc:1434] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260924 02:04:30.683493 3966 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:30.686662 2996 tablet_service.cc:1511] Processing CreateTablet for tablet cf979f356ade4302be6e8bc0d2b3e46e (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.687126 2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf979f356ade4302be6e8bc0d2b3e46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.688908 2997 tablet_service.cc:1511] Processing CreateTablet for tablet ecb43a38e52a4fe4a457f769d7bd847a (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.689276 2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb43a38e52a4fe4a457f769d7bd847a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2d8d1ff61f clone at ??:0
I20260924 02:04:30.690542 3274 tablet_service.cc:1511] Processing CreateTablet for tablet cf979f356ade4302be6e8bc0d2b3e46e (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.690861 3276 tablet_service.cc:1511] Processing CreateTablet for tablet ecb43a38e52a4fe4a457f769d7bd847a (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.690979 3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf979f356ade4302be6e8bc0d2b3e46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.691252 3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb43a38e52a4fe4a457f769d7bd847a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.691845 3966 tablet_bootstrap.cc:654] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.699066 3965 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:30.701053 3965 tablet_bootstrap.cc:654] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.673707 3958 ts_tablet_manager.cc:1950] T 711a7b2e55214fd0a7849d997ebfcf92 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:30.687785 3134 tablet_service.cc:1511] Processing CreateTablet for tablet ecb43a38e52a4fe4a457f769d7bd847a (DEFAULT_TABLE table=default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.707722 3134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb43a38e52a4fe4a457f769d7bd847a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.685743 3135 tablet_service.cc:1511] Processing CreateTablet for tablet cf979f356ade4302be6e8bc0d2b3e46e (DEFAULT_TABLE table=default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 02:04:30.711750 3135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf979f356ade4302be6e8bc0d2b3e46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 02:04:30.721487 3968 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:30.726818 3968 tablet_bootstrap.cc:654] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.736431 3958 tablet_replica.cc:333] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:30.736763 3958 raft_consensus.cc:2243] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.736994 3958 raft_consensus.cc:2272] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.737851 3958 ts_tablet_manager.cc:1916] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.740609 3966 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:30.740789 3966 ts_tablet_manager.cc:1403] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.019s
I20260924 02:04:30.741698 3966 raft_consensus.cc:359] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.741922 3966 raft_consensus.cc:385] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.742007 3966 raft_consensus.cc:740] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.742278 3966 consensus_queue.cc:260] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.742914 3966 ts_tablet_manager.cc:1434] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260924 02:04:30.743237 3966 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:30.745337 3966 tablet_bootstrap.cc:654] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.752753 3965 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:30.752965 3965 ts_tablet_manager.cc:1403] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.070s user 0.012s sys 0.010s
I20260924 02:04:30.753835 3965 raft_consensus.cc:359] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.754052 3965 raft_consensus.cc:385] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.754184 3965 raft_consensus.cc:740] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.754503 3965 consensus_queue.cc:260] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.755138 3965 ts_tablet_manager.cc:1434] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260924 02:04:30.755558 3965 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:30.757517 3965 tablet_bootstrap.cc:654] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.764788 3968 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:30.765007 3968 ts_tablet_manager.cc:1403] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.011s
I20260924 02:04:30.765256 3958 ts_tablet_manager.cc:1929] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.765497 3958 log.cc:1199] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/e1dbf6dbef74400d9c54d1bc44333982
I20260924 02:04:30.766072 3958 ts_tablet_manager.cc:1950] T e1dbf6dbef74400d9c54d1bc44333982 P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:30.766408 3968 raft_consensus.cc:359] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.766660 3968 raft_consensus.cc:385] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.766781 3968 raft_consensus.cc:740] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.767162 3968 consensus_queue.cc:260] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.770550 3958 tablet_replica.cc:333] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: stopping tablet replica
I20260924 02:04:30.770823 3958 raft_consensus.cc:2243] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 02:04:30.771165 3965 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:30.771242 3958 raft_consensus.cc:2272] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 02:04:30.771366 3965 ts_tablet_manager.cc:1403] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260924 02:04:30.771999 3958 ts_tablet_manager.cc:1916] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 02:04:30.772379 3968 ts_tablet_manager.cc:1434] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260924 02:04:30.772447 3965 raft_consensus.cc:359] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.772714 3965 raft_consensus.cc:385] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.772840 3965 raft_consensus.cc:740] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.773170 3965 consensus_queue.cc:260] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.774243 3965 ts_tablet_manager.cc:1434] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260924 02:04:30.774619 3965 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5: Bootstrap starting.
I20260924 02:04:30.778090 3965 tablet_bootstrap.cc:654] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.780172 3966 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:30.780402 3966 ts_tablet_manager.cc:1403] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.002s
I20260924 02:04:30.781273 3966 raft_consensus.cc:359] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.781505 3966 raft_consensus.cc:385] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.781598 3966 raft_consensus.cc:740] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.781848 3968 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:30.781877 3966 consensus_queue.cc:260] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.782467 3966 ts_tablet_manager.cc:1434] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260924 02:04:30.782787 3966 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:30.784860 3966 tablet_bootstrap.cc:654] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.786053 3916 raft_consensus.cc:493] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:30.786226 3916 raft_consensus.cc:515] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.787016 3916 leader_election.cc:290] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.788085 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:30.788743 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
W20260924 02:04:30.789558 2952 leader_election.cc:343] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273): Illegal state: must be running to vote when last-logged opid is not known
W20260924 02:04:30.789863 2953 leader_election.cc:343] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417): Illegal state: must be running to vote when last-logged opid is not known
I20260924 02:04:30.790028 2953 leader_election.cc:304] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9543f73523d42ad9995f4ac079044b5; no voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289
I20260924 02:04:30.790477 3916 raft_consensus.cc:2749] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260924 02:04:30.794195 3968 tablet_bootstrap.cc:654] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.796653 3966 tablet_bootstrap.cc:492] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:30.796818 3966 ts_tablet_manager.cc:1403] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260924 02:04:30.797618 3966 raft_consensus.cc:359] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.797823 3966 raft_consensus.cc:385] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.797915 3966 raft_consensus.cc:740] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.798213 3966 consensus_queue.cc:260] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.801692 3958 ts_tablet_manager.cc:1929] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260924 02:04:30.801836 3958 log.cc:1199] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Deleting WAL directory at /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/ts-1/wal/wals/ae040db05d8b477392beb0d413e25b5f
I20260924 02:04:30.802326 3958 ts_tablet_manager.cc:1950] T ae040db05d8b477392beb0d413e25b5f P c3d5f64871b3487b9705befe2938e289: Deleting consensus metadata
I20260924 02:04:30.803758 3966 ts_tablet_manager.cc:1434] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260924 02:04:30.805949 3965 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5: No bootstrap required, opened a new log
I20260924 02:04:30.806138 3965 ts_tablet_manager.cc:1403] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.003s
I20260924 02:04:30.807487 3965 raft_consensus.cc:359] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.807686 3965 raft_consensus.cc:385] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.807767 3965 raft_consensus.cc:740] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.808027 3965 consensus_queue.cc:260] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.808808 3965 ts_tablet_manager.cc:1434] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 02:04:30.809286 3966 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6: Bootstrap starting.
I20260924 02:04:30.811540 3966 tablet_bootstrap.cc:654] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.813835 3966 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6: No bootstrap required, opened a new log
I20260924 02:04:30.814015 3966 ts_tablet_manager.cc:1403] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260924 02:04:30.814553 3968 tablet_bootstrap.cc:492] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:30.814736 3968 ts_tablet_manager.cc:1403] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.002s
I20260924 02:04:30.815289 3966 raft_consensus.cc:359] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.815492 3966 raft_consensus.cc:385] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.815564 3966 raft_consensus.cc:740] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.815852 3966 consensus_queue.cc:260] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.816435 3966 ts_tablet_manager.cc:1434] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260924 02:04:30.816802 3968 raft_consensus.cc:359] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.817018 3968 raft_consensus.cc:385] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.817094 3968 raft_consensus.cc:740] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.817408 3968 consensus_queue.cc:260] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.820534 3968 ts_tablet_manager.cc:1434] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260924 02:04:30.821552 3968 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:30.825523 3968 tablet_bootstrap.cc:654] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.828344 3968 tablet_bootstrap.cc:492] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:30.828524 3968 ts_tablet_manager.cc:1403] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260924 02:04:30.829562 3968 raft_consensus.cc:359] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.829805 3968 raft_consensus.cc:385] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.829898 3968 raft_consensus.cc:740] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.830178 3968 consensus_queue.cc:260] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.831024 3968 ts_tablet_manager.cc:1434] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260924 02:04:30.831501 3968 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289: Bootstrap starting.
I20260924 02:04:30.833652 3968 tablet_bootstrap.cc:654] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289: Neither blocks nor log segments found. Creating new log.
I20260924 02:04:30.836102 3968 tablet_bootstrap.cc:492] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289: No bootstrap required, opened a new log
I20260924 02:04:30.836293 3968 ts_tablet_manager.cc:1403] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260924 02:04:30.837163 3968 raft_consensus.cc:359] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.837402 3968 raft_consensus.cc:385] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 02:04:30.837482 3968 raft_consensus.cc:740] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Initialized, Role: FOLLOWER
I20260924 02:04:30.837865 3968 consensus_queue.cc:260] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.839797 3968 ts_tablet_manager.cc:1434] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260924 02:04:30.848948 3916 raft_consensus.cc:493] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:30.849243 3916 raft_consensus.cc:515] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.850039 3916 leader_election.cc:290] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.850831 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b6ba7dcaec4fa1bb58d28bed3b0d54" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:30.851158 3156 raft_consensus.cc:2468] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:30.851166 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b6ba7dcaec4fa1bb58d28bed3b0d54" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:30.851454 3296 raft_consensus.cc:2468] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 0.
I20260924 02:04:30.851770 2952 leader_election.cc:304] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:30.852499 3916 raft_consensus.cc:2804] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:30.852649 3916 raft_consensus.cc:493] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:30.852754 3916 raft_consensus.cc:3060] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.854022 3914 raft_consensus.cc:493] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:30.854214 3914 raft_consensus.cc:515] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.855134 3914 leader_election.cc:290] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.855855 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:30.855966 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6" is_pre_election: true
I20260924 02:04:30.856166 3018 raft_consensus.cc:2468] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:30.856259 3296 raft_consensus.cc:2468] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 0.
I20260924 02:04:30.856730 3090 leader_election.cc:304] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:30.856557 3916 raft_consensus.cc:515] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.857390 3914 raft_consensus.cc:2804] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:30.857542 3914 raft_consensus.cc:493] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:30.857638 3914 raft_consensus.cc:3060] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.857847 3916 leader_election.cc:290] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Requested vote from peers c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.860051 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b6ba7dcaec4fa1bb58d28bed3b0d54" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:30.860195 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b6ba7dcaec4fa1bb58d28bed3b0d54" candidate_uuid: "d9543f73523d42ad9995f4ac079044b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:30.860322 3296 raft_consensus.cc:3060] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.860494 3156 raft_consensus.cc:3060] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.860759 3914 raft_consensus.cc:515] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.862154 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:30.862432 3018 raft_consensus.cc:3060] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.863729 3296 raft_consensus.cc:2468] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:30.863897 3156 raft_consensus.cc:2468] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9543f73523d42ad9995f4ac079044b5 in term 1.
I20260924 02:04:30.864612 2952 leader_election.cc:304] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:30.864982 3916 raft_consensus.cc:2804] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:30.865839 3018 raft_consensus.cc:2468] T cf979f356ade4302be6e8bc0d2b3e46e P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:30.867244 3090 leader_election.cc:304] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d5f64871b3487b9705befe2938e289, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:30.867589 3815 raft_consensus.cc:2804] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:30.867816 3815 raft_consensus.cc:697] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [term 1 LEADER]: Becoming Leader. State: Replica: c3d5f64871b3487b9705befe2938e289, State: Running, Role: LEADER
I20260924 02:04:30.868187 3815 consensus_queue.cc:237] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:30.868525 3296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf979f356ade4302be6e8bc0d2b3e46e" candidate_uuid: "c3d5f64871b3487b9705befe2938e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79827750d7ae4673803de4e9415165e6"
I20260924 02:04:30.868741 3296 raft_consensus.cc:3060] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:30.868865 3914 leader_election.cc:290] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:30.872133 3296 raft_consensus.cc:2468] T cf979f356ade4302be6e8bc0d2b3e46e P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d5f64871b3487b9705befe2938e289 in term 1.
I20260924 02:04:30.873795 3916 raft_consensus.cc:697] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [term 1 LEADER]: Becoming Leader. State: Replica: d9543f73523d42ad9995f4ac079044b5, State: Running, Role: LEADER
I20260924 02:04:30.874231 3916 consensus_queue.cc:237] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
W20260924 02:04:30.997520 3231 connection.cc:573] server connection from 127.0.0.1:54378 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:30.997591 3354 connection.cc:573] client connection to 127.2.79.253:40759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:30.998132 2953 connection.cc:573] server connection from 127.0.0.1:49114 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:30.998257 3093 connection.cc:573] client connection to 127.2.79.253:40759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:30.998579 3354 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.253:40759)
W20260924 02:04:30.999290 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:30.999303 3232 connection.cc:573] client connection to 127.2.79.253:40759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:30.999574 3354 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:31.000087 3354 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:31.000950 3092 connection.cc:573] server connection from 127.0.0.1:53296 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 02:04:31.029749 3947 raft_consensus.cc:493] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:31.029995 3947 raft_consensus.cc:515] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.030896 3947 leader_election.cc:290] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:31.031598 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb43a38e52a4fe4a457f769d7bd847a" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:31.031606 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb43a38e52a4fe4a457f769d7bd847a" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:31.031839 3018 raft_consensus.cc:2468] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:31.031836 3156 raft_consensus.cc:2468] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:31.032323 3229 leader_election.cc:304] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:31.032681 3947 raft_consensus.cc:2804] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:31.032804 3947 raft_consensus.cc:493] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:31.032902 3947 raft_consensus.cc:3060] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.035171 3947 raft_consensus.cc:515] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.036370 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb43a38e52a4fe4a457f769d7bd847a" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:31.036585 3018 raft_consensus.cc:3060] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.038836 3018 raft_consensus.cc:2468] T ecb43a38e52a4fe4a457f769d7bd847a P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:31.039499 3947 leader_election.cc:290] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:31.039574 3229 leader_election.cc:304] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:31.039911 3947 raft_consensus.cc:2804] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:31.040199 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb43a38e52a4fe4a457f769d7bd847a" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:31.040436 3156 raft_consensus.cc:3060] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.040416 3947 raft_consensus.cc:697] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Becoming Leader. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Running, Role: LEADER
I20260924 02:04:31.040794 3947 consensus_queue.cc:237] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.043378 3156 raft_consensus.cc:2468] T ecb43a38e52a4fe4a457f769d7bd847a P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:31.114784 3947 raft_consensus.cc:493] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:31.115127 3947 raft_consensus.cc:515] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.115983 3947 leader_election.cc:290] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:31.116643 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee2924ddec4843bbd9b17eea0024cf" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289" is_pre_election: true
I20260924 02:04:31.116674 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee2924ddec4843bbd9b17eea0024cf" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5" is_pre_election: true
I20260924 02:04:31.116981 3156 raft_consensus.cc:2468] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:31.117056 3018 raft_consensus.cc:2468] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 0.
I20260924 02:04:31.117522 3230 leader_election.cc:304] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, c3d5f64871b3487b9705befe2938e289; no voters:
I20260924 02:04:31.117875 3947 raft_consensus.cc:2804] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 02:04:31.117960 3947 raft_consensus.cc:493] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:31.118047 3947 raft_consensus.cc:3060] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.120371 3947 raft_consensus.cc:515] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.121081 3947 leader_election.cc:290] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Requested vote from peers d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159), c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:31.121652 3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee2924ddec4843bbd9b17eea0024cf" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9543f73523d42ad9995f4ac079044b5"
I20260924 02:04:31.121812 3156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee2924ddec4843bbd9b17eea0024cf" candidate_uuid: "79827750d7ae4673803de4e9415165e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d5f64871b3487b9705befe2938e289"
I20260924 02:04:31.121892 3018 raft_consensus.cc:3060] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.122081 3156 raft_consensus.cc:3060] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 0 FOLLOWER]: Advancing to term 1
I20260924 02:04:31.124141 3018 raft_consensus.cc:2468] T 47ee2924ddec4843bbd9b17eea0024cf P d9543f73523d42ad9995f4ac079044b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:31.124812 3156 raft_consensus.cc:2468] T 47ee2924ddec4843bbd9b17eea0024cf P c3d5f64871b3487b9705befe2938e289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79827750d7ae4673803de4e9415165e6 in term 1.
I20260924 02:04:31.124873 3229 leader_election.cc:304] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79827750d7ae4673803de4e9415165e6, d9543f73523d42ad9995f4ac079044b5; no voters:
I20260924 02:04:31.125331 3947 raft_consensus.cc:2804] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 02:04:31.125691 3947 raft_consensus.cc:697] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [term 1 LEADER]: Becoming Leader. State: Replica: 79827750d7ae4673803de4e9415165e6, State: Running, Role: LEADER
I20260924 02:04:31.126087 3947 consensus_queue.cc:237] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 } } peers { permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 } } peers { permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 } }
I20260924 02:04:31.178789 3995 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:31.179132 3995 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:31.180274 3995 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:31.186494 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:31.186760 3856 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:31.186918 3856 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:31.187335 3995 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260924 02:04:31.752008 3815 consensus_queue.cc:1048] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:31.759763 3815 consensus_queue.cc:1048] T cf979f356ade4302be6e8bc0d2b3e46e P c3d5f64871b3487b9705befe2938e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:31.885417 4008 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:31.885649 4008 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:31.886420 4008 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:31.889353 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:31.889658 3856 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:31.889851 3856 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:31.890174 4008 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260924 02:04:32.034554 3947 consensus_queue.cc:1048] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.045997 4014 consensus_queue.cc:1048] T ecb43a38e52a4fe4a457f769d7bd847a P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.047721 3916 consensus_queue.cc:1048] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.065961 4020 consensus_queue.cc:1048] T 86b6ba7dcaec4fa1bb58d28bed3b0d54 P d9543f73523d42ad9995f4ac079044b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79827750d7ae4673803de4e9415165e6" member_type: VOTER last_known_addr { host: "127.2.79.195" port: 43417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.155130 3947 consensus_queue.cc:1048] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" member_type: VOTER last_known_addr { host: "127.2.79.193" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.161748 4013 consensus_queue.cc:1048] T 47ee2924ddec4843bbd9b17eea0024cf P 79827750d7ae4673803de4e9415165e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d5f64871b3487b9705befe2938e289" member_type: VOTER last_known_addr { host: "127.2.79.194" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 02:04:32.812208 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--webserver_interface=127.2.79.253
--webserver_port=39211
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:32.831585 4031 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:32.831835 4031 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:32.832628 4031 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:32.835333 3856 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:32.835512 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:32.835631 3855 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:32.835924 4031 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260924 02:04:33.199555 4030 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:33.199922 4030 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:33.199998 4030 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:33.209861 4030 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:33.209980 4030 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:33.210036 4030 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:33.210075 4030 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:33.221396 4030 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.79.253
--webserver_port=39211
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:33.223426 4030 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:33.225277 4030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:33.235530 4042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:33.235759 4044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:33.236238 4041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:33.236775 4030 server_base.cc:1061] running on GCE node
I20260924 02:04:33.237708 4030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:33.239560 4030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:33.240878 4030 hybrid_clock.cc:648] HybridClock initialized: now 1790215473240821 us; error 71 us; skew 500 ppm
I20260924 02:04:33.241394 4030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:33.244125 4030 webserver.cc:533] Webserver started at http://127.2.79.253:39211/ using document root <none> and password file <none>
I20260924 02:04:33.245131 4030 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:33.245314 4030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:33.252471 4030 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260924 02:04:33.256435 4050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:33.258143 4030 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 02:04:33.258461 4030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
uuid: "23f4e9ecc0904d0ba15506c5c2206881"
format_stamp: "Formatted at 2026-09-24 02:04:18 on dist-test-slave-q97n"
I20260924 02:04:33.259431 4030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:33.281877 4030 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:33.282912 4030 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:33.283319 4030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:33.309554 4030 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.253:40759
I20260924 02:04:33.309576 4105 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.253:40759 every 8 connection(s)
I20260924 02:04:33.311395 4030 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
I20260924 02:04:33.314870 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4030
I20260924 02:04:33.320058 4106 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:33.324223 4106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap starting.
I20260924 02:04:33.344581 4106 log.cc:826] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:33.412199 4106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap replayed 1/1 log segments. Stats: ops{read=86 overwritten=0 applied=86 ignored=0} inserts{seen=55 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:33.412811 4106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap complete.
I20260924 02:04:33.419315 4106 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:33.420065 4106 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Initialized, Role: FOLLOWER
I20260924 02:04:33.420797 4106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 86, Last appended: 3.86, Last appended by leader: 86, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:33.421754 4110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:33.421999 4110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:33.422892 4106 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:33.453703 4124 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:33.453861 4124 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: loading cluster ID for follower catalog manager: success
I20260924 02:04:33.458909 4124 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: acquiring CA information for follower catalog manager: success
I20260924 02:04:33.462376 4124 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:33.492731 4030 master_runner.cc:187] Error getting master registration for 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111),
I20260924 02:04:33.496603 4030 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:33.719372 3343 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:33.723003 4069 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:42663; Asking this server to re-register.
I20260924 02:04:33.723964 3343 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:33.726099 4069 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:33.748863 4131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:33.749083 4131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:33.750052 4131 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:33.753173 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:33.758353 4081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 4 candidate_status { last_received { term: 3 index: 86 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881" is_pre_election: true
I20260924 02:04:33.759024 4081 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b31e7e4c8ff4e30980f19a91551e618 in term 3.
I20260924 02:04:33.759706 3856 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:33.760093 4131 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260924 02:04:33.760308 4131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:33.760419 4131 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 3 FOLLOWER]: Advancing to term 4
I20260924 02:04:33.762524 4131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:33.763386 4131 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 election: Requested vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:33.763911 4081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b31e7e4c8ff4e30980f19a91551e618" candidate_term: 4 candidate_status { last_received { term: 3 index: 86 } } ignore_live_leader: false dest_uuid: "23f4e9ecc0904d0ba15506c5c2206881"
I20260924 02:04:33.764158 4081 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 3 FOLLOWER]: Advancing to term 4
W20260924 02:04:33.764981 3855 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:33.770556 4081 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b31e7e4c8ff4e30980f19a91551e618 in term 4.
I20260924 02:04:33.771469 3856 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:33.772897 4131 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Leader election won for term 4
I20260924 02:04:33.780622 4131 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 LEADER]: Becoming Leader. State: Replica: 9b31e7e4c8ff4e30980f19a91551e618, State: Running, Role: LEADER
I20260924 02:04:33.781296 4131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 3.86, Last appended by leader: 86, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:33.783722 4137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b31e7e4c8ff4e30980f19a91551e618. Latest consensus state: current_term: 4 leader_uuid: "9b31e7e4c8ff4e30980f19a91551e618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:33.784099 4137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:33.785681 4139 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:33.790254 4139 catalog_manager.cc:692] Loaded metadata for table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:33.790510 3065 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:33.790921 4139 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:33.791448 4139 catalog_manager.cc:692] Loaded metadata for table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:33.791913 4139 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:33.792338 4139 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:33.792793 4139 catalog_manager.cc:692] Loaded metadata for table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]
I20260924 02:04:33.792953 4069 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:48579; Asking this server to re-register.
I20260924 02:04:33.793223 4139 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:33.793669 4139 catalog_manager.cc:692] Loaded metadata for table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:33.793812 3065 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:33.794106 4139 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:33.794534 4139 catalog_manager.cc:692] Loaded metadata for table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:33.794981 4139 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:33.795408 4139 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:33.795671 4069 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:33.795892 4139 catalog_manager.cc:692] Loaded metadata for table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:33.796335 4139 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:33.796783 4139 catalog_manager.cc:692] Loaded metadata for table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:33.799784 4139 tablet_loader.cc:96] loaded metadata for tablet 008867a4d35a44e694f3c54334cb8426 (table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419])
I20260924 02:04:33.800230 4139 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:33.800912 4139 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:33.801838 4139 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:33.804410 4139 tablet_loader.cc:96] loaded metadata for tablet 47ee2924ddec4843bbd9b17eea0024cf (table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b])
I20260924 02:04:33.805615 4139 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:33.806573 4139 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:33.808046 4139 tablet_loader.cc:96] loaded metadata for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:33.808717 4139 tablet_loader.cc:96] loaded metadata for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:33.809571 4139 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:33.810012 4139 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:33.810357 4139 tablet_loader.cc:96] loaded metadata for tablet a2ab1d437fd4456a939b52c636395722 (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:33.811363 4139 tablet_loader.cc:96] loaded metadata for tablet cf979f356ade4302be6e8bc0d2b3e46e (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a])
I20260924 02:04:33.812027 4139 tablet_loader.cc:96] loaded metadata for tablet d42ebee0a393495ba5e792b81938b516 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:33.813235 4139 tablet_loader.cc:96] loaded metadata for tablet ecb43a38e52a4fe4a457f769d7bd847a (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:33.813607 4139 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:33.815356 4139 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:33.816097 4139 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:33.818256 4139 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:33.819912 4139 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Loaded TSK: 0
I20260924 02:04:33.821292 4139 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:33.823086 4139 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:33.823828 3204 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:33.824769 4139 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 20
I20260924 02:04:33.826666 4069 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:52869; Asking this server to re-register.
I20260924 02:04:33.827585 3204 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:33.829301 4069 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
F20260924 02:04:33.865561 3938 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 13 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fe37eb94d5d google::LogMessage::Fail() at ??:0
@ 0x7fe37eb98b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fe37eb9475c google::LogMessage::Flush() at ??:0
@ 0x7fe37eb949a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe39588e344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fe39588cbf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fe39589486c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260924 02:04:33.898633 3866 master_service.cc:960] ReplaceTablet: received request to replace tablet 008867a4d35a44e694f3c54334cb8426 from {username='slave'} at 127.0.0.1:38662
I20260924 02:04:33.899801 3869 master_service.cc:960] ReplaceTablet: received request to replace tablet 008867a4d35a44e694f3c54334cb8426 from {username='slave'} at 127.0.0.1:38662
@ 0x7fe3958946e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260924 02:04:33.900367 3867 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fb0a9028ad343b8aa431e1cc921c3f5 from {username='slave'} at 127.0.0.1:38662
@ 0xaaef9d std::function<>::operator()() at ??:?
I20260924 02:04:33.899987 3862 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38662:
table { table_name: "default.Table_b81c77bac5c04d7c964e800c79c26424" } new_table_name: "default.Table_a87f341ff11a4093b40822eba1becb79" modify_external_catalogs: true
I20260924 02:04:33.903493 3868 master_service.cc:960] ReplaceTablet: received request to replace tablet a2ab1d437fd4456a939b52c636395722 from {username='slave'} at 127.0.0.1:38662
I20260924 02:04:33.903868 3865 master_service.cc:960] ReplaceTablet: received request to replace tablet 42853fb879f54da281cd265b23129631 from {username='slave'} at 127.0.0.1:38662
I20260924 02:04:33.904036 3864 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38662:
name: "default.Table_4663cbdf50b8450da4834dbd10a89975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:33.904639 3863 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38662:
name: "default.Table_499006f092ed41f5b24d87bc4e22afff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:33.905902 3860 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38662:
name: "default.Table_904c8f422670443ea9468dad039b48de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:33.906488 3861 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38662:
name: "default.Table_ed7eaded3b054037b5dd91310436391b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:33.916903 4081 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Refusing update from remote peer 9b31e7e4c8ff4e30980f19a91551e618: Log matching property violated. Preceding OpId in replica: term: 3 index: 86. Preceding OpId from leader: term: 4 index: 88. (index mismatch)
@ 0x7fe3818e4079 kudu::Thread::SuperviseThread() at ??:0
W20260924 02:04:33.917387 3855 consensus_peers.cc:597] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 -> Peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Couldn't send request to peer 2629a26254094afb829bb3ca8fa2c593. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 02:04:33.917961 4137 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
@ 0x7fe384fba6db start_thread at ??:0
@ 0x7fe37da4161f clone at ??:0
I20260924 02:04:33.925673 4110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b31e7e4c8ff4e30980f19a91551e618. Latest consensus state: current_term: 4 leader_uuid: "9b31e7e4c8ff4e30980f19a91551e618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:33.925913 4110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
W20260924 02:04:34.119854 4052 connection.cc:573] server connection from 127.0.0.1:39158 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:34.121325 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.254:45523)
W20260924 02:04:34.121870 3354 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.254:45523)
W20260924 02:04:34.122256 3354 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.254:45523)
W20260924 02:04:34.122509 3354 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.254:45523)
I20260924 02:04:34.420356 4110 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:34.420607 4110 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:34.422819 4110 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:34.425431 4054 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:34.427286 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:34.427503 4053 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:34.427691 4053 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:34.428071 4110 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260924 02:04:34.997195 4164 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:34.997403 4164 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:34.998133 4164 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:35.000962 4053 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:35.001204 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:35.001341 4054 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:35.001618 4164 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260924 02:04:35.892987 4178 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:35.893227 4178 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:35.893960 4178 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:35.896246 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:35.896437 4053 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:35.896602 4053 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:35.896960 4178 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260924 02:04:36.740494 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--webserver_interface=127.2.79.252
--webserver_port=42477
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:37.133824 4194 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:37.134235 4194 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.135195 4194 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:37.137962 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:37.138588 4053 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:37.138732 4053 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:37.139081 4194 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260924 02:04:37.155313 4189 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:37.155759 4189 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:37.155910 4189 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:37.167091 4189 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:37.167237 4189 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:37.167336 4189 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:37.167419 4189 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:37.178865 4189 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.79.252
--webserver_port=42477
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:37.180752 4189 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:37.183367 4189 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:37.194262 4202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:37.195632 4205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:37.195667 4203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:37.196650 4189 server_base.cc:1061] running on GCE node
I20260924 02:04:37.197683 4189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:37.199568 4189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:37.200847 4189 hybrid_clock.cc:648] HybridClock initialized: now 1790215477200746 us; error 66 us; skew 500 ppm
I20260924 02:04:37.201290 4189 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:37.204154 4189 webserver.cc:533] Webserver started at http://127.2.79.252:42477/ using document root <none> and password file <none>
I20260924 02:04:37.205103 4189 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:37.205232 4189 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:37.212586 4189 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260924 02:04:37.216796 4211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:37.218703 4189 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260924 02:04:37.219081 4189 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:37.219959 4189 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:37.241051 4189 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:37.243228 4189 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:37.243733 4189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:37.270279 4189 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.252:44061
I20260924 02:04:37.270335 4265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.252:44061 every 8 connection(s)
I20260924 02:04:37.272369 4189 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
I20260924 02:04:37.277799 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4189
I20260924 02:04:37.281374 4266 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:37.285961 4266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap starting.
I20260924 02:04:37.304008 3063 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:37.310257 4266 log.cc:826] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:37.339110 3202 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:37.383404 4266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap replayed 1/1 log segments. Stats: ops{read=80 overwritten=0 applied=79 ignored=0} inserts{seen=50 ignored=0} mutations{seen=66 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260924 02:04:37.384047 4266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap complete.
I20260924 02:04:37.389806 4266 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.392966 4266 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Initialized, Role: FOLLOWER
I20260924 02:04:37.394001 4266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 79, Last appended: 2.80, Last appended by leader: 80, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.395073 4273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:37.395360 4273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:37.396234 4266 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:37.420912 4287 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:37.421207 4287 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: loading cluster ID for follower catalog manager: success
I20260924 02:04:37.427269 4287 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: acquiring CA information for follower catalog manager: success
I20260924 02:04:37.422873 4189 master_runner.cc:187] Error getting master registration for 127.2.79.254:45523: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111),
I20260924 02:04:37.430220 4189 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:37.432704 4287 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:37.653086 4291 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:37.653292 4291 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.654104 4291 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:37.656776 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:37.663468 4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 5 candidate_status { last_received { term: 4 index: 89 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593" is_pre_election: true
I20260924 02:04:37.664172 4241 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 2.
I20260924 02:04:37.664935 4053 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593; no voters: 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:37.665460 4291 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260924 02:04:37.665592 4291 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9b31e7e4c8ff4e30980f19a91551e618)
I20260924 02:04:37.665714 4291 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 4 FOLLOWER]: Advancing to term 5
I20260924 02:04:37.669024 4291 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.669932 4291 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:37.670678 4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 5 candidate_status { last_received { term: 4 index: 89 } } ignore_live_leader: false dest_uuid: "2629a26254094afb829bb3ca8fa2c593"
I20260924 02:04:37.670984 4241 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 2 FOLLOWER]: Advancing to term 5
W20260924 02:04:37.671872 4054 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
I20260924 02:04:37.678375 4241 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 5.
I20260924 02:04:37.679052 4053 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593; no voters: 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:37.679412 4291 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Leader election won for term 5
I20260924 02:04:37.680022 4291 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 LEADER]: Becoming Leader. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Running, Role: LEADER
I20260924 02:04:37.680636 4291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 4.89, Last appended by leader: 89, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:37.682726 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:37.683157 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:37.756775 3341 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:37.761034 4231 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:58963; Asking this server to re-register.
I20260924 02:04:37.762496 3341 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:37.765345 4231 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:37.811100 4231 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:59569; Asking this server to re-register.
I20260924 02:04:37.812019 3063 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:37.814143 4231 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:37.846649 4231 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:58351; Asking this server to re-register.
I20260924 02:04:37.847939 3202 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:37.850083 4231 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
W20260924 02:04:38.069157 4054 consensus_peers.cc:597] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 -> Peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Couldn't send request to peer 9b31e7e4c8ff4e30980f19a91551e618. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 02:04:38.123369 4241 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Refusing update from remote peer 23f4e9ecc0904d0ba15506c5c2206881: Log matching property violated. Preceding OpId in replica: term: 2 index: 80. Preceding OpId from leader: term: 5 index: 90. (index mismatch)
I20260924 02:04:38.124681 4295 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 79, Time since last communication: 0.000s
I20260924 02:04:38.135552 4302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.135447 4298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.135988 4302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:38.135984 4298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:38.136547 4300 mvcc.cc:204] Tried to move back new op lower bound from 7332722567860875264 to 7332722564528070656. Current Snapshot: MvccSnapshot[applied={T|T < 7332722567860875264 or (T in {7332722567860875264})}]
I20260924 02:04:38.138561 4306 mvcc.cc:204] Tried to move back new op lower bound from 7332722581148942336 to 7332722580613881856. Current Snapshot: MvccSnapshot[applied={T|T < 7332722581148942336}]
I20260924 02:04:38.140867 4302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.141126 4302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:38.142311 4298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.142524 4298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:38.143513 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.143795 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:38.143735 4310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:38.144083 4310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:38.201325 4297 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:38.204229 4297 catalog_manager.cc:692] Loaded metadata for table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:38.204689 4297 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:38.205045 4297 catalog_manager.cc:692] Loaded metadata for table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:38.205340 4297 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:38.205612 4297 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:38.205895 4297 catalog_manager.cc:692] Loaded metadata for table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]
I20260924 02:04:38.206167 4297 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:38.206444 4297 catalog_manager.cc:692] Loaded metadata for table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:38.206722 4297 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:38.207079 4297 catalog_manager.cc:692] Loaded metadata for table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:38.207389 4297 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:38.207701 4297 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:38.207993 4297 catalog_manager.cc:692] Loaded metadata for table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:38.208271 4297 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:38.208539 4297 catalog_manager.cc:692] Loaded metadata for table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:38.210661 4297 tablet_loader.cc:96] loaded metadata for tablet 0412004b12354a7d8e0f08ff675d91cd (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:38.210930 4297 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:38.211433 4297 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:38.211997 4297 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:38.212267 4297 tablet_loader.cc:96] loaded metadata for tablet 47ee2924ddec4843bbd9b17eea0024cf (table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b])
I20260924 02:04:38.212518 4297 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:38.213063 4297 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:38.213299 4297 tablet_loader.cc:96] loaded metadata for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:38.213706 4297 tablet_loader.cc:96] loaded metadata for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:38.214231 4297 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:38.214497 4297 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:38.215288 4297 tablet_loader.cc:96] loaded metadata for tablet cf979f356ade4302be6e8bc0d2b3e46e (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a])
I20260924 02:04:38.215706 4297 tablet_loader.cc:96] loaded metadata for tablet d42ebee0a393495ba5e792b81938b516 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:38.216373 4297 tablet_loader.cc:96] loaded metadata for tablet e7fa030f3937412589d98d2e6627678d (table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419])
I20260924 02:04:38.216621 4297 tablet_loader.cc:96] loaded metadata for tablet ecb43a38e52a4fe4a457f769d7bd847a (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:38.216868 4297 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:38.217988 4297 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:38.218060 4297 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:38.219480 4297 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:38.220456 4297 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Loaded TSK: 0
I20260924 02:04:38.221532 4297 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:38.222508 4297 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:38.223647 4297 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 20
I20260924 02:04:38.289819 4068 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_65af2e2ad1fa42629241f4230f5ca9c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.291178 4061 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39136:
table { table_name: "default.Table_635d6d13e9ef48aca3c221ede242342e" } new_table_name: "default.Table_fc4bacb12c874dae97a891c69ad096f1" modify_external_catalogs: true
I20260924 02:04:38.289741 4069 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_a03adf7b11ae4b39ac0273d0e3cf5142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.291682 4066 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_da49dc787bc94e6f99faf522e45a9529"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.291090 4067 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_907164ea3ff94d82b3bcf3280de38fbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.292510 4065 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39136:
table { table_name: "default.Table_3c5dbb4d423945049a0ff011434aea7f" } modify_external_catalogs: true
I20260924 02:04:38.292562 4064 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_e6a5702bf6ca46bb8828000eca4e6ab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.293017 4063 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39136:
table { table_name: "default.Table_f9050bc88b744848bdda785ead091fe3" } modify_external_catalogs: true
I20260924 02:04:38.292778 4065 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39136:
table { table_name: "default.Table_3c5dbb4d423945049a0ff011434aea7f" } modify_external_catalogs: true
I20260924 02:04:38.293689 4060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_4663cbdf50b8450da4834dbd10a89975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:38.293668 4063 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39136:
table { table_name: "default.Table_f9050bc88b744848bdda785ead091fe3" } modify_external_catalogs: true
I20260924 02:04:38.292608 4062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39136:
name: "default.Table_977f2cf6a8ee46e7969fac8820a1a6ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260924 02:04:38.297981 4123 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 13 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fe874e89d5d google::LogMessage::Fail() at ??:0
@ 0x7fe874e8db23 google::LogMessage::SendToLog() at ??:0
@ 0x7fe874e8975c google::LogMessage::Flush() at ??:0
@ 0x7fe874e899a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe88bb83344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fe88bb81bf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fe88bb8986c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fe88bb896e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaef9d std::function<>::operator()() at ??:?
@ 0x7fe877bd9079 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe87b2af6db start_thread at ??:0
@ 0x7fe873d3661f clone at ??:0
W20260924 02:04:38.523196 3093 connection.cc:573] client connection to 127.2.79.253:40759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:38.525110 3354 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:38.525532 3354 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:38.525971 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:38.527462 3354 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.253:40759)
I20260924 02:04:38.639017 4298 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:38.639312 4298 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:38.642086 4298 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:38.643944 4215 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:38.645891 4215 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:38.646302 4215 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:38.646440 4215 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:38.646870 4298 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:38.753196 3343 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:39.320556 4331 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:39.320799 4331 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:39.321723 4331 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:39.324527 4215 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:39.324899 4215 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:39.325124 4215 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:39.325459 4331 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:39.841970 2367 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu pid 4189
I20260924 02:04:39.858695 4261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 02:04:39.981170 2367 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu with pid 4189
I20260924 02:04:40.966212 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--webserver_interface=127.2.79.252
--webserver_port=42477
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260924 02:04:41.370306 4340 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:41.370736 4340 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:41.370896 4340 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:41.380492 4340 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:41.380636 4340 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:41.380697 4340 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:41.380738 4340 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:41.392071 4340 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.79.252
--webserver_port=42477
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:41.393716 4340 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:41.395576 4340 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:41.405257 4346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:41.405433 4345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:41.406059 4348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:41.406551 4340 server_base.cc:1061] running on GCE node
I20260924 02:04:41.407562 4340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:41.409338 4340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:41.410631 4340 hybrid_clock.cc:648] HybridClock initialized: now 1790215481410592 us; error 39 us; skew 500 ppm
I20260924 02:04:41.411139 4340 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:41.413995 4340 webserver.cc:533] Webserver started at http://127.2.79.252:42477/ using document root <none> and password file <none>
I20260924 02:04:41.415712 4340 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:41.415875 4340 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:41.422803 4340 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260924 02:04:41.426548 4354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:41.428826 4340 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 02:04:41.429075 4340 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:41.429915 4340 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:41.454674 4340 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:41.455788 4340 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:41.456144 4340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:41.482502 4340 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.252:44061
I20260924 02:04:41.482517 4405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.252:44061 every 8 connection(s)
I20260924 02:04:41.484647 4340 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
I20260924 02:04:41.489842 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4340
I20260924 02:04:41.497828 4406 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:41.503420 4406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap starting.
I20260924 02:04:41.505807 3202 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:41.524121 4406 log.cc:826] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:41.598431 4406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=90 ignored=0} inserts{seen=57 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:41.599139 4406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap complete.
I20260924 02:04:41.604986 4406 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:41.605772 4406 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Initialized, Role: FOLLOWER
I20260924 02:04:41.606587 4406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 5.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:41.607642 4411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:41.608019 4411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:41.608815 4406 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:41.623785 4425 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:41.624042 4425 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: loading cluster ID for follower catalog manager: success
I20260924 02:04:41.629595 4425 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: acquiring CA information for follower catalog manager: success
I20260924 02:04:41.625643 4340 master_runner.cc:187] Error getting master registration for 127.2.79.254:45523: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111),
I20260924 02:04:41.632026 4340 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:41.633607 4425 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:41.795651 3341 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:41.800648 4370 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:54233; Asking this server to re-register.
I20260924 02:04:41.801864 3341 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:41.804761 4370 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:41.844138 3063 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:41.846365 4370 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:50639; Asking this server to re-register.
I20260924 02:04:41.847239 3063 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:41.849854 4370 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:42.011296 4370 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:48669; Asking this server to re-register.
I20260924 02:04:42.012535 3202 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:42.015350 4370 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:42.187813 4429 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:42.188143 4429 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:42.190145 4429 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:42.191646 4358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:42.193506 4358 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:42.193841 4358 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:42.193939 4358 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:42.194370 4429 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:42.820403 4433 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:42.820731 4433 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:42.821578 4433 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:42.824229 4358 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:42.824573 4358 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:42.824703 4358 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:42.825042 4433 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:43.675629 2367 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu pid 4340
I20260924 02:04:43.684571 4401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260924 02:04:43.805867 2367 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu with pid 4340
W20260924 02:04:43.829689 3231 connection.cc:573] client connection to 127.2.79.252:44061 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 02:04:44.401820 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--webserver_interface=127.2.79.252
--webserver_port=42477
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260924 02:04:44.802436 4442 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:44.803337 4442 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:44.803571 4442 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:44.818344 4442 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:44.818755 4442 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:44.819409 4442 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:44.819543 4442 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:44.831743 4442 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.252:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.79.252
--webserver_port=42477
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:44.834733 4442 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:44.837999 4442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:44.853024 4447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:44.853394 4450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:44.853434 4448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:44.854780 4442 server_base.cc:1061] running on GCE node
I20260924 02:04:44.856077 4442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:44.859097 4442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:44.860437 4442 hybrid_clock.cc:648] HybridClock initialized: now 1790215484860337 us; error 93 us; skew 500 ppm
I20260924 02:04:44.861007 4442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:44.865554 4442 webserver.cc:533] Webserver started at http://127.2.79.252:42477/ using document root <none> and password file <none>
I20260924 02:04:44.866596 4442 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:44.866734 4442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:44.874315 4442 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260924 02:04:44.881593 4456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:44.884704 4442 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.006s sys 0.001s
I20260924 02:04:44.885143 4442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
uuid: "2629a26254094afb829bb3ca8fa2c593"
format_stamp: "Formatted at 2026-09-24 02:04:19 on dist-test-slave-q97n"
I20260924 02:04:44.886539 4442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:44.909515 4442 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:44.910709 4442 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:44.911144 4442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:44.942920 4442 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.252:44061
I20260924 02:04:44.943104 4507 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.252:44061 every 8 connection(s)
I20260924 02:04:44.945124 4442 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-2/data/info.pb
I20260924 02:04:44.947569 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4442
I20260924 02:04:44.955381 4508 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:44.959949 4508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap starting.
I20260924 02:04:44.990614 4508 log.cc:826] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:45.040482 3202 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:45.091902 4508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=90 ignored=0} inserts{seen=57 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:45.092657 4508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Bootstrap complete.
I20260924 02:04:45.099057 4508 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:45.099822 4508 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Initialized, Role: FOLLOWER
I20260924 02:04:45.100512 4508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 5.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:45.101580 4514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:45.102124 4514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:45.102998 4508 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:45.119333 4528 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:45.119622 4528 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: loading cluster ID for follower catalog manager: success
I20260924 02:04:45.114635 4442 master_runner.cc:187] Error getting master registration for 127.2.79.254:45523: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111),
I20260924 02:04:45.121984 4442 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:45.126657 4528 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: acquiring CA information for follower catalog manager: success
I20260924 02:04:45.131495 4528 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:45.340903 3341 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:45.343394 4473 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:54413; Asking this server to re-register.
I20260924 02:04:45.344249 3341 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:45.346385 4473 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:45.372689 3063 heartbeater.cc:344] Connected to a master server at 127.2.79.252:44061
I20260924 02:04:45.374735 4473 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:54581; Asking this server to re-register.
I20260924 02:04:45.375465 3063 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:45.377332 4473 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:45.509361 4514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:45.509696 4514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:45.512143 4514 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:45.512945 4460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:45.515280 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:45.515723 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:45.515856 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:45.516229 4514 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:45.546614 4473 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:57017; Asking this server to re-register.
I20260924 02:04:45.547466 3202 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:45.549434 4473 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:46.080355 4534 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:46.080579 4534 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:46.081369 4534 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:46.083855 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:46.084120 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:46.084285 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:46.084618 4534 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:47.108767 4539 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:47.109014 4539 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:47.109917 4539 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:47.113581 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:47.113839 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:47.113947 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:47.114212 4539 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:48.163089 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--webserver_interface=127.2.79.254
--webserver_port=39869
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:48.218276 4544 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:48.218495 4544 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.219375 4544 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:48.222244 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523): Network error: Client connection negotiation failed: client connection to 127.2.79.254:45523: connect: Connection refused (error 111)
W20260924 02:04:48.222527 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:48.222656 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:48.222998 4544 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260924 02:04:48.567090 4543 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:48.567521 4543 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:48.567672 4543 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:48.578845 4543 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:48.579059 4543 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:48.579207 4543 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:48.579298 4543 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:48.591526 4543 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.254:45523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.79.254
--webserver_port=39869
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:48.593546 4543 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:48.595779 4543 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:48.606788 4553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:48.606835 4555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:48.606856 4552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:48.608619 4543 server_base.cc:1061] running on GCE node
I20260924 02:04:48.609583 4543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:48.611366 4543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:48.612670 4543 hybrid_clock.cc:648] HybridClock initialized: now 1790215488612618 us; error 83 us; skew 500 ppm
I20260924 02:04:48.613119 4543 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:48.615727 4543 webserver.cc:533] Webserver started at http://127.2.79.254:39869/ using document root <none> and password file <none>
I20260924 02:04:48.616559 4543 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:48.616709 4543 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:48.623291 4543 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20260924 02:04:48.626906 4561 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:48.628886 4543 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260924 02:04:48.629125 4543 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
uuid: "9b31e7e4c8ff4e30980f19a91551e618"
format_stamp: "Formatted at 2026-09-24 02:04:17 on dist-test-slave-q97n"
I20260924 02:04:48.629951 4543 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:48.647789 4543 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:48.648839 4543 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:48.649408 4543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:48.675843 4543 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.254:45523
I20260924 02:04:48.675866 4612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.254:45523 every 8 connection(s)
I20260924 02:04:48.677662 4543 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-0/data/info.pb
I20260924 02:04:48.678429 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4543
I20260924 02:04:48.687014 4613 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:48.691581 4613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap starting.
I20260924 02:04:48.713037 4613 log.cc:826] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:48.785899 4613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap replayed 1/1 log segments. Stats: ops{read=91 overwritten=0 applied=86 ignored=0} inserts{seen=55 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260924 02:04:48.786854 4613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Bootstrap complete.
I20260924 02:04:48.790855 3342 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:48.794901 4613 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.799191 4613 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b31e7e4c8ff4e30980f19a91551e618, State: Initialized, Role: FOLLOWER
I20260924 02:04:48.800127 4613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 86, Last appended: 4.91, Last appended by leader: 91, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.801385 4619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:48.801827 4619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:48.802843 4613 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:48.818084 4633 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:48.818240 4633 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: loading cluster ID for follower catalog manager: success
I20260924 02:04:48.822592 4633 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: acquiring CA information for follower catalog manager: success
I20260924 02:04:48.827857 4633 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:48.829457 4637 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:48.829705 4637 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.830674 4637 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
W20260924 02:04:48.838932 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:48.851260 3064 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:48.848769 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:04:48.856760 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:48.856284 4588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 6 candidate_status { last_received { term: 5 index: 90 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:48.857442 4578 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:44653; Asking this server to re-register.
I20260924 02:04:48.857998 4588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2629a26254094afb829bb3ca8fa2c593 in term 4.
I20260924 02:04:48.858811 3064 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:48.859031 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881
I20260924 02:04:48.859427 4637 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260924 02:04:48.859586 4637 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:48.859691 4637 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 5 FOLLOWER]: Advancing to term 6
I20260924 02:04:48.861783 4578 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:48.864533 4637 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.865435 4637 leader_election.cc:290] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759)
I20260924 02:04:48.866664 4588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629a26254094afb829bb3ca8fa2c593" candidate_term: 6 candidate_status { last_received { term: 5 index: 90 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618"
W20260924 02:04:48.867630 4460 leader_election.cc:336] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:48.867000 4588 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 4 FOLLOWER]: Advancing to term 6
I20260924 02:04:48.874847 4588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2629a26254094afb829bb3ca8fa2c593 in term 6.
I20260924 02:04:48.875762 4460 leader_election.cc:304] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881
I20260924 02:04:48.876200 4637 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 6 FOLLOWER]: Leader election won for term 6
I20260924 02:04:48.876842 4637 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [term 6 LEADER]: Becoming Leader. State: Replica: 2629a26254094afb829bb3ca8fa2c593, State: Running, Role: LEADER
I20260924 02:04:48.877784 3203 heartbeater.cc:344] Connected to a master server at 127.2.79.254:45523
I20260924 02:04:48.877621 4637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 5.90, Last appended by leader: 90, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:48.880044 4578 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:54543; Asking this server to re-register.
I20260924 02:04:48.880875 3203 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:48.881043 4643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629a26254094afb829bb3ca8fa2c593. Latest consensus state: current_term: 6 leader_uuid: "2629a26254094afb829bb3ca8fa2c593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:48.881412 4643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:48.882726 4578 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:48.884863 4645 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:48.887815 4645 catalog_manager.cc:692] Loaded metadata for table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:48.888314 4645 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:48.888705 4645 catalog_manager.cc:692] Loaded metadata for table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:48.889068 4645 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:48.889401 4645 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:48.889762 4645 catalog_manager.cc:692] Loaded metadata for table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]
I20260924 02:04:48.890082 4645 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:48.890431 4645 catalog_manager.cc:692] Loaded metadata for table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:48.890762 4645 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:48.891178 4645 catalog_manager.cc:692] Loaded metadata for table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:48.891506 4645 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:48.891839 4645 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:48.892191 4645 catalog_manager.cc:692] Loaded metadata for table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:48.892539 4645 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:48.892879 4645 catalog_manager.cc:692] Loaded metadata for table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:48.895462 4645 tablet_loader.cc:96] loaded metadata for tablet 0412004b12354a7d8e0f08ff675d91cd (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:48.895916 4645 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:48.896422 4645 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:48.897253 4645 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:48.897656 4645 tablet_loader.cc:96] loaded metadata for tablet 47ee2924ddec4843bbd9b17eea0024cf (table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b])
I20260924 02:04:48.898115 4645 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:48.898824 4645 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:48.899205 4645 tablet_loader.cc:96] loaded metadata for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:48.899878 4645 tablet_loader.cc:96] loaded metadata for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:48.900489 4645 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:48.900844 4645 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:48.901703 4645 tablet_loader.cc:96] loaded metadata for tablet cf979f356ade4302be6e8bc0d2b3e46e (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a])
I20260924 02:04:48.902333 4645 tablet_loader.cc:96] loaded metadata for tablet d42ebee0a393495ba5e792b81938b516 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:48.903414 4645 tablet_loader.cc:96] loaded metadata for tablet e7fa030f3937412589d98d2e6627678d (table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419])
I20260924 02:04:48.903822 4645 tablet_loader.cc:96] loaded metadata for tablet ecb43a38e52a4fe4a457f769d7bd847a (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:48.904243 4645 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:48.905434 4645 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:48.905542 4645 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:48.907191 4645 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:48.908185 4645 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 2629a26254094afb829bb3ca8fa2c593: Loaded TSK: 0
I20260924 02:04:48.909093 4645 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:48.910077 4645 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:48.911170 4645 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 20
I20260924 02:04:48.952489 4470 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:48.952934 4470 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:48.953038 4473 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_2bbb2478ff414d04806f78dccbcabc8c" } new_table_name: "default.Table_1e2b7e9fe77d4e91b084be7959d3fb89" modify_external_catalogs: true
I20260924 02:04:48.953536 4468 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_4fd30425787341509cfacfe3c2b7ad27" } new_table_name: "default.Table_1a94f2e11784451691899fad0e5660d6" modify_external_catalogs: true
I20260924 02:04:48.953997 4467 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47018:
name: "default.Table_904c8f422670443ea9468dad039b48de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:48.954496 4466 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47018:
name: "default.Table_ed7eaded3b054037b5dd91310436391b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:48.955303 4464 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47018:
name: "default.Table_e6a5702bf6ca46bb8828000eca4e6ab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:48.955977 4472 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_ca026bc3ca2044659a0f0d9a2a3fa7c0" } new_table_name: "default.Table_0693b1cf142145dc9afb7a130116f455" modify_external_catalogs: true
I20260924 02:04:48.956082 4465 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_b81c77bac5c04d7c964e800c79c26424" } new_table_name: "default.Table_a87f341ff11a4093b40822eba1becb79" modify_external_catalogs: true
I20260924 02:04:48.952862 4469 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
I20260924 02:04:48.952549 4471 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:48.956568 4471 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:48.956509 4469 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47018:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
F20260924 02:04:48.964550 4527 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 13 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f413a96ad5d google::LogMessage::Fail() at ??:0
@ 0x7f413a96eb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f413a96a75c google::LogMessage::Flush() at ??:0
@ 0x7f413a96a9a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f4151664344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f4151662bf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f415166a86c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f415166a6e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaef9d std::function<>::operator()() at ??:?
@ 0x7f413d6ba079 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4140d906db start_thread at ??:0
@ 0x7f413981761f clone at ??:0
W20260924 02:04:49.225857 3092 connection.cc:573] client connection to 127.2.79.252:44061 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:49.227313 3353 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.252:44061)
W20260924 02:04:49.227901 3353 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.252:44061)
W20260924 02:04:49.228636 3353 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.252:44061)
W20260924 02:04:49.229046 3353 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.252:44061)
I20260924 02:04:49.296976 4578 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:56143; Asking this server to re-register.
I20260924 02:04:49.297878 3342 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:49.299985 4577 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:49.393617 4658 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:49.393827 4658 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:49.396736 4658 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:49.398180 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:49.400285 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:49.400619 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:49.400777 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:49.401153 4658 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260924 02:04:50.144670 4663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:50.144943 4663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:50.145819 4663 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:50.148264 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:50.148505 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:50.148659 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:50.148945 4663 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260924 02:04:51.050300 4667 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:51.050501 4667 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:51.051308 4667 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:51.054057 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:51.054473 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:51.054610 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:51.054998 4667 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260924 02:04:51.604296 2367 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
/tmp/dist-test-taskAnoS2b/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--webserver_interface=127.2.79.253
--webserver_port=39211
--builtin_ntp_servers=127.2.79.212:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260924 02:04:52.014317 4672 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:52.014639 4672 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:52.021934 4672 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:52.027082 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:52.027372 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:52.027500 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:52.027834 4672 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260924 02:04:52.133404 4671 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 02:04:52.133836 4671 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 02:04:52.133986 4671 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260924 02:04:52.143033 4671 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 02:04:52.143155 4671 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260924 02:04:52.143234 4671 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 02:04:52.143306 4671 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260924 02:04:52.154659 4671 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.79.212:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35885
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.79.253:40759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.79.253
--webserver_port=39211
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision ee47a9ca1939200e227f9bf266c97a7c0eed3ccc
build type FASTDEBUG
built by None at 24 Sep 2026 01:43:21 UTC on bdcb31816ec0
build id 13969
ASAN enabled
I20260924 02:04:52.156567 4671 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 02:04:52.158748 4671 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260924 02:04:52.168493 4680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:52.168438 4681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 02:04:52.168459 4683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 02:04:52.169335 4671 server_base.cc:1061] running on GCE node
I20260924 02:04:52.170240 4671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 02:04:52.172109 4671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 02:04:52.173364 4671 hybrid_clock.cc:648] HybridClock initialized: now 1790215492173328 us; error 60 us; skew 500 ppm
I20260924 02:04:52.173801 4671 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260924 02:04:52.176705 4671 webserver.cc:533] Webserver started at http://127.2.79.253:39211/ using document root <none> and password file <none>
I20260924 02:04:52.177580 4671 fs_manager.cc:362] Metadata directory not provided
I20260924 02:04:52.177752 4671 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 02:04:52.184590 4671 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260924 02:04:52.188491 4689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 02:04:52.190616 4671 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260924 02:04:52.190924 4671 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data,/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
uuid: "23f4e9ecc0904d0ba15506c5c2206881"
format_stamp: "Formatted at 2026-09-24 02:04:18 on dist-test-slave-q97n"
I20260924 02:04:52.191926 4671 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 02:04:52.214170 4671 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260924 02:04:52.215250 4671 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 02:04:52.215608 4671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 02:04:52.239259 4740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.79.253:40759 every 8 connection(s)
I20260924 02:04:52.239360 4671 rpc_server.cc:307] RPC server started. Bound to: 127.2.79.253:40759
I20260924 02:04:52.241290 4671 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/master-1/data/info.pb
I20260924 02:04:52.243763 2367 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAnoS2b/build/asan/bin/kudu as pid 4671
I20260924 02:04:52.251452 4741 sys_catalog.cc:263] Verifying existing consensus state
I20260924 02:04:52.256779 4741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap starting.
I20260924 02:04:52.276561 4741 log.cc:826] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Log is configured to *not* fsync() on all Append() calls
I20260924 02:04:52.304579 3343 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:52.304864 3343 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:52.353161 4741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=90 ignored=0} inserts{seen=57 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 02:04:52.353765 4741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Bootstrap complete.
I20260924 02:04:52.359457 4741 raft_consensus.cc:359] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:52.360244 4741 raft_consensus.cc:740] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Initialized, Role: FOLLOWER
I20260924 02:04:52.360982 4741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 5.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:52.362126 4745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:52.362500 4745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:52.363485 4741 sys_catalog.cc:565] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 02:04:52.391283 4759 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:52.391487 4759 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: loading cluster ID for follower catalog manager: success
I20260924 02:04:52.396299 4759 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: acquiring CA information for follower catalog manager: success
I20260924 02:04:52.399654 4759 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 02:04:52.416785 4671 master_runner.cc:187] Error getting master registration for 127.2.79.252:44061: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111),
I20260924 02:04:52.423081 4671 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:52.573282 3065 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:52.573839 3204 heartbeater.cc:344] Connected to a master server at 127.2.79.253:40759
I20260924 02:04:52.576239 4706 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d9543f73523d42ad9995f4ac079044b5" instance_seqno: 1790215460423660) as {username='slave'} at 127.2.79.193:40269; Asking this server to re-register.
I20260924 02:04:52.576267 4705 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c3d5f64871b3487b9705befe2938e289" instance_seqno: 1790215461055970) as {username='slave'} at 127.2.79.194:54077; Asking this server to re-register.
I20260924 02:04:52.577117 3204 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:52.577279 3065 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:52.579772 4706 ts_manager.cc:194] Registered new tserver with Master: c3d5f64871b3487b9705befe2938e289 (127.2.79.194:39273)
I20260924 02:04:52.579936 4705 ts_manager.cc:194] Registered new tserver with Master: d9543f73523d42ad9995f4ac079044b5 (127.2.79.193:43159)
I20260924 02:04:52.810045 3343 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:52.813153 4706 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "79827750d7ae4673803de4e9415165e6" instance_seqno: 1790215461680871) as {username='slave'} at 127.2.79.195:49055; Asking this server to re-register.
I20260924 02:04:52.814213 3343 heartbeater.cc:461] Registering TS with master...
I20260924 02:04:52.816382 4706 ts_manager.cc:194] Registered new tserver with Master: 79827750d7ae4673803de4e9415165e6 (127.2.79.195:43417)
I20260924 02:04:52.938648 4766 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:52.939023 4766 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:52.941097 4766 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:52.941883 4588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 6 candidate_status { last_received { term: 5 index: 90 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:52.942338 4588 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23f4e9ecc0904d0ba15506c5c2206881 in current term 6: Already voted for candidate 2629a26254094afb829bb3ca8fa2c593 in this term.
W20260924 02:04:52.942435 4692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:52.944485 4692 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:52.944729 4692 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881; no voters: 2629a26254094afb829bb3ca8fa2c593, 9b31e7e4c8ff4e30980f19a91551e618
I20260924 02:04:52.945231 4766 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 5 FOLLOWER]: Advancing to term 6
I20260924 02:04:52.950448 4766 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260924 02:04:53.681974 4775 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 02:04:53.682325 4775 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:53.683235 4775 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:53.683807 4588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 7 candidate_status { last_received { term: 5 index: 90 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618" is_pre_election: true
I20260924 02:04:53.684108 4588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 6.
I20260924 02:04:53.684664 4693 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters:
I20260924 02:04:53.685055 4775 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260924 02:04:53.685249 4775 raft_consensus.cc:493] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 02:04:53.685379 4775 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 6 FOLLOWER]: Advancing to term 7
W20260924 02:04:53.685777 4692 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:53.687737 4775 raft_consensus.cc:515] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:53.688436 4775 leader_election.cc:290] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 election: Requested vote from peers 9b31e7e4c8ff4e30980f19a91551e618 (127.2.79.254:45523), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
I20260924 02:04:53.688982 4588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23f4e9ecc0904d0ba15506c5c2206881" candidate_term: 7 candidate_status { last_received { term: 5 index: 90 } } ignore_live_leader: false dest_uuid: "9b31e7e4c8ff4e30980f19a91551e618"
I20260924 02:04:53.689213 4588 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 6 FOLLOWER]: Advancing to term 7
W20260924 02:04:53.690030 4692 leader_election.cc:336] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:53.691280 4588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23f4e9ecc0904d0ba15506c5c2206881 in term 7.
I20260924 02:04:53.691787 4693 leader_election.cc:304] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23f4e9ecc0904d0ba15506c5c2206881, 9b31e7e4c8ff4e30980f19a91551e618; no voters: 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:53.692195 4775 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 7 FOLLOWER]: Leader election won for term 7
I20260924 02:04:53.692588 4775 raft_consensus.cc:697] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [term 7 LEADER]: Becoming Leader. State: Replica: 23f4e9ecc0904d0ba15506c5c2206881, State: Running, Role: LEADER
I20260924 02:04:53.693090 4775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 5.90, Last appended by leader: 90, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:53.695485 4778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.695832 4778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:53.696545 4780 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260924 02:04:53.699645 4780 catalog_manager.cc:692] Loaded metadata for table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8]
I20260924 02:04:53.700163 4780 catalog_manager.cc:692] Loaded metadata for table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550]
I20260924 02:04:53.700559 4780 catalog_manager.cc:692] Loaded metadata for table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93]
I20260924 02:04:53.700922 4780 catalog_manager.cc:692] Loaded metadata for table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e]
I20260924 02:04:53.701270 4780 catalog_manager.cc:692] Loaded metadata for table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b]
I20260924 02:04:53.701637 4780 catalog_manager.cc:692] Loaded metadata for table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b]
I20260924 02:04:53.701982 4780 catalog_manager.cc:692] Loaded metadata for table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68]
I20260924 02:04:53.702355 4780 catalog_manager.cc:692] Loaded metadata for table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4]
I20260924 02:04:53.702703 4780 catalog_manager.cc:692] Loaded metadata for table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658]
I20260924 02:04:53.703163 4780 catalog_manager.cc:692] Loaded metadata for table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a]
I20260924 02:04:53.703508 4780 catalog_manager.cc:692] Loaded metadata for table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029]
I20260924 02:04:53.703863 4780 catalog_manager.cc:692] Loaded metadata for table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3]
I20260924 02:04:53.704283 4780 catalog_manager.cc:692] Loaded metadata for table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c]
I20260924 02:04:53.704646 4780 catalog_manager.cc:692] Loaded metadata for table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab]
I20260924 02:04:53.704972 4780 catalog_manager.cc:692] Loaded metadata for table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419]
I20260924 02:04:53.707425 4780 tablet_loader.cc:96] loaded metadata for tablet 0412004b12354a7d8e0f08ff675d91cd (table default.table_94cdcfd6ac7e484d9e474aa7fe3793fe [id=a187d91dc3344f25ac20853589a681b3])
I20260924 02:04:53.707813 4780 tablet_loader.cc:96] loaded metadata for tablet 057be33fa10b4480b69af12f3800ce80 (table default.table_635d6d13e9ef48aca3c221ede242342e [id=7326711a164e44aea0a2686a91820cc4])
I20260924 02:04:53.708288 4780 tablet_loader.cc:96] loaded metadata for tablet 0ca399002f6a489cbdddbbec7b0cc4a7 (table default.table_4da96035b3984c33b90f53644baa2a0f [id=7092e6ba32624fe0baa1bdd50b802b68])
I20260924 02:04:53.708911 4780 tablet_loader.cc:96] loaded metadata for tablet 42853fb879f54da281cd265b23129631 (table default.table_ca026bc3ca2044659a0f0d9a2a3fa7c0 [id=d26b20efde04498ab7e76f79cd6840ab])
I20260924 02:04:53.709251 4780 tablet_loader.cc:96] loaded metadata for tablet 47ee2924ddec4843bbd9b17eea0024cf (table default.table_499006f092ed41f5b24d87bc4e22afff [id=6dc4ff1146624ae3a6eade6146bc887b])
I20260924 02:04:53.709578 4780 tablet_loader.cc:96] loaded metadata for tablet 6257a7b0828648b690113c2ad78260ad (table default.table_f9adc6e782ff4b0da3c645863cec8907 [id=10c5532e2ced4f8ebd55aec2b043a550])
I20260924 02:04:53.710176 4780 tablet_loader.cc:96] loaded metadata for tablet 8654b43c40cb4c328ea519d645b9447e (table default.table_4fd30425787341509cfacfe3c2b7ad27 [id=14dd5cc717d74fdaa08de01e492c0d93])
I20260924 02:04:53.710470 4780 tablet_loader.cc:96] loaded metadata for tablet 86b6ba7dcaec4fa1bb58d28bed3b0d54 (table default.table_2bbb2478ff414d04806f78dccbcabc8c [id=ad901044a40b4a65b759e58912e9b84c])
I20260924 02:04:53.710940 4780 tablet_loader.cc:96] loaded metadata for tablet 8fb0a9028ad343b8aa431e1cc921c3f5 (table default.table_b81c77bac5c04d7c964e800c79c26424 [id=75cc1a17a2fa4413b36354a69a7a7658])
I20260924 02:04:53.711588 4780 tablet_loader.cc:96] loaded metadata for tablet 958ced04a94b47aebff1f92b0f32ccf2 (table default.table_685250380f8543c9bbaeca23f7d90fef [id=067c44fc84be4184bbb36a7e1c997aa8])
I20260924 02:04:53.711902 4780 tablet_loader.cc:96] loaded metadata for tablet a0402fd077bb4f169f9af62a255d79fe (table default.table_713dab067b0f4190bad1daff3eb7bff8 [id=95b449916858461abc889ded49d01029])
I20260924 02:04:53.712653 4780 tablet_loader.cc:96] loaded metadata for tablet cf979f356ade4302be6e8bc0d2b3e46e (table default.table_3c5dbb4d423945049a0ff011434aea7f [id=8523e928a5224cd39782311e053dda3a])
I20260924 02:04:53.713136 4780 tablet_loader.cc:96] loaded metadata for tablet d42ebee0a393495ba5e792b81938b516 (table default.table_f021dac94f15432cac9fc0e59d54b0be [id=284369232efd4855983dda0e812b7d0e])
I20260924 02:04:53.713881 4780 tablet_loader.cc:96] loaded metadata for tablet e7fa030f3937412589d98d2e6627678d (table default.table_f9050bc88b744848bdda785ead091fe3 [id=ea7df6d2a55c4b6e8c006d1c386f7419])
I20260924 02:04:53.714190 4780 tablet_loader.cc:96] loaded metadata for tablet ecb43a38e52a4fe4a457f769d7bd847a (table default.table_784a6bfac1a7463294326833a9ec4c8a [id=2879b988bc1841438b7aa1eee24dd28b])
I20260924 02:04:53.714483 4780 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260924 02:04:53.716038 4780 catalog_manager.cc:1308] Loaded cluster ID: 9f7997950a4e4e2fb03c5dfe8f2cf0bc
I20260924 02:04:53.716150 4780 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260924 02:04:53.717571 4780 catalog_manager.cc:1553] Loading token signing keys...
I20260924 02:04:53.718567 4780 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Loaded TSK: 0
I20260924 02:04:53.719632 4780 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260924 02:04:53.720692 4780 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260924 02:04:53.721706 4780 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: 20
I20260924 02:04:53.771795 4706 master_service.cc:960] ReplaceTablet: received request to replace tablet 008867a4d35a44e694f3c54334cb8426 from {username='slave'} at 127.0.0.1:57718
I20260924 02:04:53.772123 4703 master_service.cc:960] ReplaceTablet: received request to replace tablet 8fb0a9028ad343b8aa431e1cc921c3f5 from {username='slave'} at 127.0.0.1:57718
I20260924 02:04:53.772595 4704 master_service.cc:960] ReplaceTablet: received request to replace tablet a2ab1d437fd4456a939b52c636395722 from {username='slave'} at 127.0.0.1:57718
I20260924 02:04:53.773587 4700 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57718:
name: "default.Table_4663cbdf50b8450da4834dbd10a89975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:53.773902 4698 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57718:
name: "default.Table_977f2cf6a8ee46e7969fac8820a1a6ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:53.774616 4702 master_service.cc:960] ReplaceTablet: received request to replace tablet 008867a4d35a44e694f3c54334cb8426 from {username='slave'} at 127.0.0.1:57718
I20260924 02:04:53.775632 4702 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:53.775947 4702 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_f9adc6e782ff4b0da3c645863cec8907" } modify_external_catalogs: true
I20260924 02:04:53.776280 4705 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57718:
name: "default.Table_499006f092ed41f5b24d87bc4e22afff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 02:04:53.776655 4701 master_service.cc:960] ReplaceTablet: received request to replace tablet 42853fb879f54da281cd265b23129631 from {username='slave'} at 127.0.0.1:57718
I20260924 02:04:53.778026 4697 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:53.778285 4704 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_4fd30425787341509cfacfe3c2b7ad27" } new_table_name: "default.Table_1a94f2e11784451691899fad0e5660d6" modify_external_catalogs: true
I20260924 02:04:53.778330 4697 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_713dab067b0f4190bad1daff3eb7bff8" } modify_external_catalogs: true
I20260924 02:04:53.779043 4706 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
I20260924 02:04:53.779299 4706 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_94cdcfd6ac7e484d9e474aa7fe3793fe" } modify_external_catalogs: true
I20260924 02:04:53.779214 4699 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_635d6d13e9ef48aca3c221ede242342e" } new_table_name: "default.Table_fc4bacb12c874dae97a891c69ad096f1" modify_external_catalogs: true
I20260924 02:04:53.784332 4588 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Refusing update from remote peer 23f4e9ecc0904d0ba15506c5c2206881: Log matching property violated. Preceding OpId in replica: term: 4 index: 91. Preceding OpId from leader: term: 7 index: 92. (index mismatch)
I20260924 02:04:53.785202 4778 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 86, Time since last communication: 0.000s
I20260924 02:04:53.785506 4778 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [LEADER]: Peer 9b31e7e4c8ff4e30980f19a91551e618 log is divergent from this leader: its last log entry 4.91 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 86
F20260924 02:04:53.787532 4758 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 21, previous 21; dumping first 2 out of 13 received events: NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_a03adf7b11ae4b39ac0273d0e3cf5142, message={"server":"","servicePrincipal":"","db":"default","table":"table_a03adf7b11ae4b39ac0273d0e3cf5142","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215465},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_a03adf7b11ae4b39ac0273d0e3cf5142\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a03adf7b11ae4b39ac0273d0e3cf5142\",\"kudu.table_id\":\"0581ca27a28b4a588e3e0c18bf5b126d\",\"transient_lastDdlTime\":\"1790215465\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=21, eventTime=1790215466, eventType=DROP_TABLE, dbName=default, tableName=table_94cdcfd6ac7e484d9e474aa7fe3793fe, message={"server":"","servicePrincipal":"","db":"default","table":"table_94cdcfd6ac7e484d9e474aa7fe3793fe","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790215463},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskAnoS2b/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790215437756932-2367-0/minicluster-data/warehouse/table_94cdcfd6ac7e484d9e474aa7fe3793fe\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_94cdcfd6ac7e484d9e474aa7fe3793fe\",\"kudu.table_id\":\"a187d91dc3344f25ac20853589a681b3\",\"transient_lastDdlTime\":\"1790215463\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9f7997950a4e4e2fb03c5dfe8f2cf0bc\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790215466}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260924 02:04:53.788803 4588 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.86->[4.87-7.93] Dedup: 4.89->[5.90-7.93]
W20260924 02:04:53.789112 4692 consensus_peers.cc:597] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 -> Peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Couldn't send request to peer 2629a26254094afb829bb3ca8fa2c593. Status: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260924 02:04:53.789165 4588 pending_rounds.cc:85] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Aborting all ops after (but not including) 89
I20260924 02:04:53.789309 4588 pending_rounds.cc:107] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Aborting uncommitted WRITE_OP operation due to leader change: 4.90
I20260924 02:04:53.790117 4588 pending_rounds.cc:107] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618: Aborting uncommitted WRITE_OP operation due to leader change: 4.91
@ 0x7fe779103d5d google::LogMessage::Fail() at ??:0
@ 0x7fe779107b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fe77910375c google::LogMessage::Flush() at ??:0
@ 0x7fe7791039a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe78fdfd344 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260924 02:04:53.809865 4793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.810245 4793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:53.810524 4784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f4e9ecc0904d0ba15506c5c2206881. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.810817 4784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:53.810271 4788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.811218 4788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fe78fdfbbf1 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260924 02:04:53.812319 4782 mvcc.cc:204] Tried to move back new op lower bound from 7332722662528131072 to 7332722662170636288. Current Snapshot: MvccSnapshot[applied={T|T < 7332722662528131072}]
I20260924 02:04:53.813212 4788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.813413 4788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 02:04:53.813330 4786 mvcc.cc:204] Tried to move back new op lower bound from 7332722662532698112 to 7332722662170636288. Current Snapshot: MvccSnapshot[applied={T|T < 7332722662528131072}]
@ 0x7fe78fe0386c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260924 02:04:53.817781 4703 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 8fb0a9028ad343b8aa431e1cc921c3f5
@ 0x7fe78fe036e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260924 02:04:53.821724 4701 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881: Sending DeleteTablet for 3 replicas of tablet 42853fb879f54da281cd265b23129631
I20260924 02:04:53.822057 4778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "23f4e9ecc0904d0ba15506c5c2206881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } } }
I20260924 02:04:53.822316 4778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f4e9ecc0904d0ba15506c5c2206881 [sys.catalog]: This master's current role is: LEADER
I20260924 02:04:53.822871 4701 catalog_manager.cc:6934] ReplaceTablet: tablet 42853fb879f54da281cd265b23129631 deleted and replaced by tablet 63ec90358e8f43e9963fb8fa48ba6907
@ 0xaaef9d std::function<>::operator()() at ??:?
I20260924 02:04:53.825378 4701 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_2bbb2478ff414d04806f78dccbcabc8c" } new_table_name: "default.Table_1e2b7e9fe77d4e91b084be7959d3fb89" modify_external_catalogs: true
@ 0x7fe77be53079 kudu::Thread::SuperviseThread() at ??:0
I20260924 02:04:53.838847 4703 catalog_manager.cc:6934] ReplaceTablet: tablet 8fb0a9028ad343b8aa431e1cc921c3f5 deleted and replaced by tablet 1ae4564078604938acfa297bea0ea12e
I20260924 02:04:53.839840 4703 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57718:
table { table_name: "default.Table_ca026bc3ca2044659a0f0d9a2a3fa7c0" } new_table_name: "default.Table_0693b1cf142145dc9afb7a130116f455" modify_external_catalogs: true
@ 0x7fe77f5296db start_thread at ??:0
@ 0x7fe777fb061f clone at ??:0
W20260924 02:04:54.051038 4802 negotiation.cc:336] Failed RPC negotiation. Trace:
0924 02:04:53.829406 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:43654 (local address 127.2.79.194:39273)
0924 02:04:53.850746 (+ 21340us) server_negotiation.cc:207] Beginning negotiation
0924 02:04:53.850756 (+ 10us) server_negotiation.cc:400] Waiting for connection header
0924 02:04:53.850784 (+ 28us) server_negotiation.cc:408] Connection header received
0924 02:04:53.850882 (+ 98us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0924 02:04:53.850890 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
0924 02:04:53.851037 (+ 147us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0924 02:04:53.851321 (+ 284us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0924 02:04:54.050609 (+199288us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43654: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":21166,"thread_start_us":22167,"threads_started":1}
W20260924 02:04:54.051069 3354 connection.cc:573] client connection to 127.2.79.253:40759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 02:04:54.052233 3354 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.79.253:40759)
W20260924 02:04:54.052879 3354 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:54.053121 3354 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:54.053755 3354 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.79.253:40759)
W20260924 02:04:54.054759 4800 negotiation.cc:336] Failed RPC negotiation. Trace:
0924 02:04:53.827462 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.2.79.195:43417)
0924 02:04:53.837999 (+ 10537us) server_negotiation.cc:207] Beginning negotiation
0924 02:04:53.838007 (+ 8us) server_negotiation.cc:400] Waiting for connection header
0924 02:04:53.838031 (+ 24us) server_negotiation.cc:408] Connection header received
0924 02:04:53.838116 (+ 85us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0924 02:04:53.838123 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
0924 02:04:53.838206 (+ 83us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0924 02:04:53.840186 (+ 1980us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0924 02:04:53.840487 (+ 301us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0924 02:04:53.844034 (+ 3547us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0924 02:04:53.847558 (+ 3524us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0924 02:04:53.849432 (+ 1874us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0924 02:04:53.849591 (+ 159us) server_negotiation.cc:1036] Waiting for connection context
0924 02:04:54.053709 (+204118us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57930: BlockingRecv error: recv got EOF from 127.0.0.1:57930 (error 108)
Metrics: {"server-negotiator.queue_time_us":10362,"thread_start_us":10176,"threads_started":1}
W20260924 02:04:54.055418 4805 negotiation.cc:336] Failed RPC negotiation. Trace:
0924 02:04:53.859766 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.79.253:40759 (local address 127.0.0.1:57734)
0924 02:04:53.860394 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0924 02:04:53.860413 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0924 02:04:53.860534 (+ 121us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0924 02:04:54.051663 (+191129us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":364,"threads_started":1}
I20260924 02:04:54.055765 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260924 02:04:54.056016 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:54.330513 3343 heartbeater.cc:499] Master 127.2.79.253:40759 was elected leader, sending a full tablet report...
I20260924 02:04:54.346084 4813 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:54.346310 4813 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:54.347219 4813 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:54.349479 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:54.349674 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:54.349848 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:54.350167 4813 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:04:54.460441 2367 master-stress-test.cc:579] Killing test thread 1/25
I20260924 02:04:55.000586 4816 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:55.000797 4816 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:55.001860 4816 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:55.003448 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260924 02:04:55.005409 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:55.005725 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:55.005879 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:55.006198 4816 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:04:55.582031 4821 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:55.582286 4821 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:55.583048 4821 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:55.585750 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:55.586110 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:55.586359 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:55.586692 4821 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:04:56.891664 4826 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:56.891921 4826 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:56.892889 4826 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:56.895824 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:04:56.896031 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:04:56.896199 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:56.896546 4826 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:04:57.413461 4830 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:57.413694 4830 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:57.414636 4830 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:57.417138 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:57.417363 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:57.417538 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:57.417865 4830 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:04:59.059716 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:04:59.059980 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:04:59.941942 4835 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:04:59.942261 4835 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:04:59.943156 4835 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:04:59.946439 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:04:59.946645 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:04:59.946790 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:04:59.947199 4835 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:04.063479 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:04.063725 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:04.346119 4841 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:04.346359 4841 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:04.347299 4841 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:04.347826 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260924 02:05:04.349524 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:04.349749 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:04.349921 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:04.350371 4841 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:06.011899 4845 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:06.012295 4845 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:06.013202 4845 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:06.016646 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:06.017005 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:06.017287 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:06.017679 4845 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:09.067556 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:09.067874 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:14.071563 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:14.071838 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:15.205574 4857 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:15.205876 4857 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:15.206836 4857 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:15.208144 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:05:15.209949 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:15.210253 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:15.210402 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:15.210832 4857 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:16.717522 4862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:16.717917 4862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:16.720088 4862 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:16.722136 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:16.722383 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:16.722575 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:16.722887 4862 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:19.075541 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:19.075816 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260924 02:05:22.174554 3204 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (56 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:22.174510 3065 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (56 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:22.419214 3343 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (56 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:05:24.078985 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:24.079246 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:28.368680 4879 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:28.368913 4879 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:28.369820 4879 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:28.372289 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:05:28.374222 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:05:28.374505 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:05:28.374676 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:28.375000 4879 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:29.083789 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:29.084054 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:29.898447 4886 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:29.898682 4886 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:29.899602 4886 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:29.902007 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:29.902190 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:29.902369 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:29.902679 4886 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:34.088161 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:34.088416 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:36.713997 4896 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:36.714473 4896 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:36.715575 4896 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:36.716857 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:05:36.719065 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:36.719323 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:36.719511 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:36.719872 4896 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:39.091938 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:39.092202 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:44.095510 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:44.095723 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:44.776085 4912 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:44.776397 4912 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:44.777868 4912 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:44.779317 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:05:44.781148 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:05:44.781446 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:05:44.781596 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:44.782038 4912 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:46.473609 4917 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:46.473838 4917 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:46.475211 4917 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:46.477679 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:05:46.477928 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:05:46.478061 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:46.478374 4917 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:49.099854 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:49.100092 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:51.159300 4927 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:05:51.159552 4927 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:05:51.160763 4927 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:05:51.162077 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:05:51.163596 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:05:51.163851 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:05:51.164021 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:05:51.164361 4927 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:05:54.104043 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:54.104246 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:05:59.107786 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:05:59.108002 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:02.268481 4944 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:06:02.268803 4944 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:06:02.269591 4944 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:06:02.271162 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:06:02.272534 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:06:02.272768 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:06:02.272900 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:06:02.273211 4944 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:06:04.111469 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:04.111737 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:07.714284 4954 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:06:07.714573 4954 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:06:07.715544 4954 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:06:07.716733 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:06:07.718299 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:06:07.718528 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:06:07.718684 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:06:07.719058 4954 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:06:09.116516 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:09.116859 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:14.120407 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:14.120589 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:19.124470 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:19.124773 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260924 02:06:22.215090 3063 heartbeater.cc:646] Failed to heartbeat to 127.2.79.252:44061 (185 consecutive failures): Network error: Failed to ping master at 127.2.79.252:44061: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:06:22.368649 3204 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (176 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:06:22.613802 3343 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (176 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:06:24.128372 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:24.128646 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:27.384575 4982 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:06:27.384819 4982 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:06:27.385746 4982 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:06:27.387794 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:06:27.389643 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:06:27.389860 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:06:27.389967 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:06:27.390190 4982 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:06:29.132288 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:29.132556 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:34.136195 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:34.136471 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:39.139752 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:39.140007 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:41.039531 5000 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:06:41.039834 5000 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:06:41.040719 5000 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:06:41.042328 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:06:41.043993 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:06:41.044152 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:06:41.044313 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:06:41.044678 5000 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:06:44.144246 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:44.144474 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:48.864900 4567 maintenance_manager.cc:419] P 9b31e7e4c8ff4e30980f19a91551e618: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033351
I20260924 02:06:48.918901 4566 maintenance_manager.cc:643] P 9b31e7e4c8ff4e30980f19a91551e618: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.053s user 0.024s sys 0.007s Metrics: {"bytes_written":21808,"cfile_init":1,"dirs.queue_time_us":447,"dirs.run_cpu_time_us":255,"dirs.run_wall_time_us":989,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":767,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":53,"thread_start_us":557,"threads_started":2,"wal-append.queue_time_us":419}
I20260924 02:06:48.920130 4567 maintenance_manager.cc:419] P 9b31e7e4c8ff4e30980f19a91551e618: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3486 bytes on disk
I20260924 02:06:48.921096 4566 maintenance_manager.cc:643] P 9b31e7e4c8ff4e30980f19a91551e618: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
I20260924 02:06:49.149238 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:49.149559 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:54.153405 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:54.153617 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:06:58.187400 5023 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:06:58.187657 5023 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:06:58.188788 5023 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:06:58.189942 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:06:58.191533 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:06:58.191747 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:06:58.191929 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:06:58.192309 5023 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:06:59.157469 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:06:59.157743 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:04.160877 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:04.161167 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:08.907537 5073 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:08.907743 5073 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:08.909014 5073 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:08.910261 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:07:08.911739 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:08.912088 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:08.912231 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:08.912531 5073 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:07:09.164714 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:09.164960 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:13.531872 5097 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:13.532097 5097 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:13.533011 5097 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:13.535784 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:13.536010 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:13.536190 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:13.536473 5097 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:07:14.168650 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:14.168905 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:19.172847 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:19.173202 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:21.411995 5139 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:21.412235 5139 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:21.412992 5139 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:21.414865 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:07:21.416392 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:21.416654 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:21.416836 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:21.417172 5139 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260924 02:07:22.401391 3063 heartbeater.cc:646] Failed to heartbeat to 127.2.79.252:44061 (305 consecutive failures): Network error: Failed to ping master at 127.2.79.252:44061: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:22.561530 3204 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (296 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:07:22.800834 3343 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (296 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:24.177356 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:24.177572 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:29.182334 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:29.182591 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:29.588047 5180 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:29.588295 5180 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:29.589119 5180 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:29.589987 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:07:29.591866 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:29.592085 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:29.592268 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:29.592605 5180 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:07:34.186640 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:34.186898 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:39.191274 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:39.191576 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:41.611860 5235 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:41.612241 5235 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:41.613082 5235 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:41.614585 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:07:41.616559 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:07:41.616794 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:07:41.616950 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:41.617231 5235 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:07:44.195796 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:44.196161 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:48.409389 5268 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:07:48.409606 5268 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:07:48.410429 5268 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:07:48.411666 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:07:48.413136 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:07:48.413427 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:07:48.413579 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:07:48.413971 5268 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:07:49.200721 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:49.201037 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:54.204824 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:54.205099 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:07:59.209074 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:07:59.209326 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:04.212999 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:04.213342 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:07.388593 5348 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:08:07.388785 5348 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:08:07.389766 5348 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:08:07.390823 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:08:07.392295 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:08:07.392504 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:08:07.392644 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:08:07.392935 5348 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:08:09.217634 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:09.217931 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:14.221482 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:14.221946 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:19.225878 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:19.226135 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:20.605139 5405 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:08:20.605412 5405 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:08:20.606420 5405 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:08:20.607493 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:08:20.608996 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:08:20.609229 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:08:20.609339 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:08:20.609634 5405 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260924 02:08:22.589468 3063 heartbeater.cc:646] Failed to heartbeat to 127.2.79.252:44061 (425 consecutive failures): Network error: Failed to ping master at 127.2.79.252:44061: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:08:22.750339 3204 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (416 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:08:22.991816 3343 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (416 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:08:24.229807 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:24.230103 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:29.234153 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:29.234440 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:30.948275 5449 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:08:30.948705 5449 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:08:30.949731 5449 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:08:30.951048 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:08:30.952685 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:08:30.953048 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:08:30.953208 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:08:30.953629 5449 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:08:34.237926 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:34.238173 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:39.242035 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:39.242337 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:44.246416 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:44.246665 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:46.487886 5512 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:08:46.488144 5512 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:08:46.489209 5512 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:08:46.490444 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:08:46.491889 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:08:46.492157 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:08:46.492331 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:08:46.492767 5512 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:08:47.011806 5518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:08:47.012059 5518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:08:47.012830 5518 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:08:47.015343 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:08:47.015612 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:08:47.015779 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:08:47.016234 5518 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:08:49.250264 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:49.250470 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:54.253782 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:54.254097 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:08:59.258157 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:08:59.258476 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:00.328579 5570 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:00.328809 5570 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:00.329861 5570 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:00.332183 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:09:00.334385 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:00.334620 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:00.334767 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:00.335119 5570 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:04.262080 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:04.262300 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:05.108139 5592 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:05.108363 5592 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:05.109221 5592 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:05.112228 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:05.112530 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:05.112721 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:05.113035 5592 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:09.265646 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:09.265877 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:14.269345 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:14.269614 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:19.273701 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:19.273998 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:22.185391 5655 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:22.185621 5655 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:22.186825 5655 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:22.188133 4564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:09:22.189785 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:22.190028 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:22.190160 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:22.190580 5655 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260924 02:09:22.776923 3063 heartbeater.cc:646] Failed to heartbeat to 127.2.79.252:44061 (545 consecutive failures): Network error: Failed to ping master at 127.2.79.252:44061: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:09:22.933069 3204 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (536 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:23.184962 3343 heartbeater.cc:646] Failed to heartbeat to 127.2.79.253:40759 (536 consecutive failures): Network error: Failed to ping master at 127.2.79.253:40759: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:09:24.277959 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:24.278182 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:29.281642 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:29.281895 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:32.133054 5693 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:32.133334 5693 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:32.134150 5693 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:32.135576 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:09:32.137137 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:32.137449 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:32.137605 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:32.137929 5693 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:34.285633 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:34.285847 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:36.608054 5712 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:36.608345 5712 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:36.609176 5712 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:36.612519 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:36.612828 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:36.612962 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:36.613209 5712 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:38.948216 5724 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:38.948519 5724 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:38.949541 5724 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:38.951234 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260924 02:09:38.952943 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:38.953312 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
I20260924 02:09:38.953492 4564 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:38.953832 5724 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:39.288879 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:39.289161 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:44.292601 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:44.292830 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:49.296895 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:49.297092 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260924 02:09:50.233901 5769 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23f4e9ecc0904d0ba15506c5c2206881)
I20260924 02:09:50.234124 5769 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b31e7e4c8ff4e30980f19a91551e618" member_type: VOTER last_known_addr { host: "127.2.79.254" port: 45523 } } peers { permanent_uuid: "23f4e9ecc0904d0ba15506c5c2206881" member_type: VOTER last_known_addr { host: "127.2.79.253" port: 40759 } } peers { permanent_uuid: "2629a26254094afb829bb3ca8fa2c593" member_type: VOTER last_known_addr { host: "127.2.79.252" port: 44061 } }
I20260924 02:09:50.234979 5769 leader_election.cc:290] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759), 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061)
W20260924 02:09:50.236099 4565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260924 02:09:50.237955 4564 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2629a26254094afb829bb3ca8fa2c593 (127.2.79.252:44061): Network error: Client connection negotiation failed: client connection to 127.2.79.252:44061: connect: Connection refused (error 111)
W20260924 02:09:50.238180 4565 leader_election.cc:336] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23f4e9ecc0904d0ba15506c5c2206881 (127.2.79.253:40759): Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
I20260924 02:09:50.238291 4565 leader_election.cc:304] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b31e7e4c8ff4e30980f19a91551e618; no voters: 23f4e9ecc0904d0ba15506c5c2206881, 2629a26254094afb829bb3ca8fa2c593
I20260924 02:09:50.238590 5769 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9b31e7e4c8ff4e30980f19a91551e618 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260924 02:09:54.013458 4567 maintenance_manager.cc:419] P 9b31e7e4c8ff4e30980f19a91551e618: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3486 bytes on disk
I20260924 02:09:54.019562 4566 maintenance_manager.cc:643] P 9b31e7e4c8ff4e30980f19a91551e618: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s user 0.005s sys 0.000s Metrics: {"dirs.queue_time_us":482,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":110,"thread_start_us":807,"threads_started":2,"wal-append.queue_time_us":633}
I20260924 02:09:54.300817 4543 master_runner.cc:187] Error getting master registration for 127.2.79.253:40759: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111),
I20260924 02:09:54.301018 4543 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260924 02:09:54.668565 3353 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:54.668897 3353 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:54.669031 3353 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
W20260924 02:09:54.669191 3353 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
F20260924 02:09:54.679986 3385 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Aborted at 1790215794 (unix time) try "date -d @1790215794" if you are using GNU date ***
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.688050 3379 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)ailed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.688050 3379 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)ailed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.688050 3379 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)ailed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) F20260924 02:09:54.688252 3376 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000093f) received by PID 2367 (TID 0x7fc008d40700) from PID 2367; stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.688050 3379 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)ailed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) F20260924 02:09:54.688252 3376 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.689323 3373 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260924 02:09:54.680442 3364 master-stress-test.cc:299] Check failed: _s.ok() Bad status: F20260924 02:09:54.680444 3365 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65af2e2ad1fa42629241f4230f5ca9c6 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)Timed out: Error creating table default.Table_4663cbdf50b8450da4834dbd10a89975 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.681659 3361 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_499006f092ed41f5b24d87bc4e22afff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682853 3360 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_904c8f422670443ea9468dad039b48de on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.682920 3384 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683084 3374 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683215 3362 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e6a5702bf6ca46bb8828000eca4e6ab8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683589 3371 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683791 3377 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.683845 3372 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685222 3368 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_da49dc787bc94e6f99faf522e45a9529 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.685245 3359 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_907164ea3ff94d82b3bcf3280de38fbc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686666 3366 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a03adf7b11ae4b39ac0273d0e3cf5142 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.686815 3363 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ed7eaded3b054037b5dd91310436391b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687206 3367 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_977f2cf6a8ee46e7969fac8820a1a6ff on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687227 3383 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687388 3380 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687713 3370 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.687732 3375 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.688050 3379 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)ailed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111) F20260924 02:09:54.688252 3376 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.689323 3373 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)F20260924 02:09:54.689486 3378 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.79.254:45523,127.2.79.253:40759,127.2.79.252:44061, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.2.79.253:40759: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fc02825d980 (unknown) at ??:0
@ 0x7fc020ff8e87 gsignal at ??:0
@ 0x7fc020ffa7f1 abort at ??:0
@ 0x7fc023d47d5d google::LogMessage::Fail() at ??:0
@ 0x7fc023d4bb23 google::LogMessage::SendToLog() at ??:0
@ 0x7fc023d4775c google::LogMessage::Flush() at ??:0
@ 0x7fc023d48ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40a6a5 kudu::MasterStressTest::ReplaceTabletThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:393
@ 0x4464f4 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x4463ad std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44636a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44631e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x446059 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fc0216826df (unknown) at ??:0
@ 0x7fc0282526db start_thread at ??:0
@ 0x7fc0210db61f clone at ??:0