Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260620 02:55:29.480144 388 test_util.cc:268] Using random seed: -1967055451
2026-06-20T02:55:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T02:55:29Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvDWu0V/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvDWu0V/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/security.properties
2026-06-20 02:55:41: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvDWu0V/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvDWu0V/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260620 02:55:48.772536 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--webserver_interface=127.0.97.62
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 02:55:49.132894 633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:49.133175 633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:49.133332 633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:49.140472 633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:55:49.140578 633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:49.140646 633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:55:49.140727 633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:55:49.150337 633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:49.151739 633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:49.153626 633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:49.165800 638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:49.165954 639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:49.166347 641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:49.167397 633 server_base.cc:1034] running on GCE node
I20260620 02:55:49.168130 633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:49.170089 633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:49.171353 633 hybrid_clock.cc:648] HybridClock initialized: now 1781924149171234 us; error 88 us; skew 500 ppm
I20260620 02:55:49.171764 633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:49.174808 633 webserver.cc:460] Webserver started at http://127.0.97.62:38827/ using document root <none> and password file <none>
I20260620 02:55:49.175498 633 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:49.175625 633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:49.175954 633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:49.178604 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/instance:
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.179343 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal/instance:
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.184386 633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260620 02:55:49.188105 647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:49.189738 633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 02:55:49.189946 633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.190160 633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:49.219616 633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:49.220480 633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:49.221279 633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:49.243098 698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:46739 every 8 connection(s)
I20260620 02:55:49.243204 633 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:46739
I20260620 02:55:49.244665 633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
I20260620 02:55:49.248411 699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:49.250201 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 633
I20260620 02:55:49.250486 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal/instance
I20260620 02:55:49.254037 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--webserver_interface=127.0.97.61
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:55:49.258045 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:49.280364 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } has no permanent_uuid. Determining permanent_uuid...
W20260620 02:55:49.281495 650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:55:49.283118 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:49.332450 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } attempt: 1
W20260620 02:55:49.334729 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:49.403072 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } attempt: 2
W20260620 02:55:49.409768 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:49.501120 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } attempt: 3
W20260620 02:55:49.503001 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:55:49.597677 700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:49.597945 700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:49.598021 700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:49.604959 700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:55:49.605053 700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:49.605093 700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:55:49.605139 700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:55:49.614360 700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:49.615558 700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:49.617203 700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:49.628772 708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:49.628898 709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:49.629988 711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:49.630771 700 server_base.cc:1034] running on GCE node
I20260620 02:55:49.631554 700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:49.632881 700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:49.634114 700 hybrid_clock.cc:648] HybridClock initialized: now 1781924149634062 us; error 36 us; skew 500 ppm
I20260620 02:55:49.634436 700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:49.636564 700 webserver.cc:460] Webserver started at http://127.0.97.61:38883/ using document root <none> and password file <none>
I20260620 02:55:49.637203 700 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:49.637351 700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:49.637645 700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:49.640225 700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/instance:
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.640995 700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal/instance:
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.645848 700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260620 02:55:49.646286 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } attempt: 4
W20260620 02:55:49.648397 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:49.653895 717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:49.655699 700 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260620 02:55:49.655884 700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:49.656057 700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:49.685997 700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:49.686818 700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:49.687107 700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:49.707412 700 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:34445
I20260620 02:55:49.707441 768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:34445 every 8 connection(s)
I20260620 02:55:49.708738 700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
I20260620 02:55:49.712301 769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:49.712599 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 700
I20260620 02:55:49.712756 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal/instance
I20260620 02:55:49.713828 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--webserver_interface=127.0.97.60
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:55:49.719033 769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:49.738138 769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:49.750213 769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } has no permanent_uuid. Determining permanent_uuid...
W20260620 02:55:49.751827 721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:55:49.754106 769 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:49.803440 769 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 1
W20260620 02:55:49.806187 769 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:49.874881 769 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 2
W20260620 02:55:49.876860 769 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:49.947691 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } attempt: 5
I20260620 02:55:49.956120 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } has no permanent_uuid. Determining permanent_uuid...
W20260620 02:55:49.958107 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:49.968072 769 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 3
W20260620 02:55:49.969941 769 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:50.009379 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 1
W20260620 02:55:50.011260 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:55:50.054177 770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:50.054490 770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:50.054566 770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:50.063642 770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:55:50.063756 770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:50.063802 770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:55:50.063851 770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:55:50.072979 770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:50.074299 770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:50.075929 770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 02:55:50.079553 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 2
W20260620 02:55:50.081547 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:55:50.088438 779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:50.088500 781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:50.088393 778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:50.089285 770 server_base.cc:1034] running on GCE node
I20260620 02:55:50.090096 770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:50.091720 770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:50.093133 770 hybrid_clock.cc:648] HybridClock initialized: now 1781924150092983 us; error 55 us; skew 500 ppm
I20260620 02:55:50.094103 770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:50.096390 770 webserver.cc:460] Webserver started at http://127.0.97.60:39951/ using document root <none> and password file <none>
I20260620 02:55:50.097069 770 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:50.097208 770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:50.097544 770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:50.100019 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/instance:
uuid: "88f31390712542bf916d639cd0e4a435"
format_stamp: "Formatted at 2026-06-20 02:55:50 on dist-test-slave-w01b"
I20260620 02:55:50.100741 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal/instance:
uuid: "88f31390712542bf916d639cd0e4a435"
format_stamp: "Formatted at 2026-06-20 02:55:50 on dist-test-slave-w01b"
I20260620 02:55:50.105809 770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260620 02:55:50.109229 787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:50.110870 770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260620 02:55:50.111078 770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
uuid: "88f31390712542bf916d639cd0e4a435"
format_stamp: "Formatted at 2026-06-20 02:55:50 on dist-test-slave-w01b"
I20260620 02:55:50.111274 770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:50.113139 769 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 4
W20260620 02:55:50.115097 769 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:50.144371 770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:50.145161 770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:50.145519 770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:50.164921 770 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:33171
I20260620 02:55:50.165015 838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:33171 every 8 connection(s)
I20260620 02:55:50.166385 770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
I20260620 02:55:50.169806 839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:50.172887 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 770
I20260620 02:55:50.173075 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal/instance
I20260620 02:55:50.176802 839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:50.187781 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 3
I20260620 02:55:50.193957 839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:50.202754 839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } has no permanent_uuid. Determining permanent_uuid...
I20260620 02:55:50.204584 699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap starting.
I20260620 02:55:50.208365 699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:50.210529 699 log.cc:824] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:50.213495 699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: No bootstrap required, opened a new log
I20260620 02:55:50.215139 839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap starting.
I20260620 02:55:50.218953 839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:50.219869 839 log.cc:824] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:50.222662 839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: No bootstrap required, opened a new log
I20260620 02:55:50.222625 699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.223366 699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:50.223491 699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Initialized, Role: FOLLOWER
I20260620 02:55:50.224180 699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.225072 848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.225466 848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.226152 699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:55:50.230939 839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.231288 839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:50.231439 839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f31390712542bf916d639cd0e4a435, State: Initialized, Role: FOLLOWER
I20260620 02:55:50.232007 839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.232796 858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.233150 858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.233824 839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:55:50.251044 770 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: OK, instance_id { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" instance_seqno: 1781924149236627 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 02:55:50.271288 770 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 02:55:50.273144 875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 02:55:50.273286 875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 02:55:50.264950 633 master_runner.cc:186] Error getting master registration for 127.0.97.61:34445: OK, instance_id { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" instance_seqno: 1781924149702163 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 02:55:50.281172 633 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 02:55:50.308532 879 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 02:55:50.308751 879 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260620 02:55:50.398223 793 tablet.cc:2369] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 02:55:50.414283 769 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } attempt: 5
I20260620 02:55:50.428371 769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap starting.
I20260620 02:55:50.432475 769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:50.446431 769 log.cc:824] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:50.452112 769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: No bootstrap required, opened a new log
I20260620 02:55:50.464979 769 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.465405 769 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:50.465523 769 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Initialized, Role: FOLLOWER
I20260620 02:55:50.466181 769 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.469770 883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.470247 883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.471092 769 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: configured and running, proceeding with master startup.
W20260620 02:55:50.474215 653 tablet.cc:2369] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 02:55:50.519837 700 master_runner.cc:263] No leader master found from master 38d9721548804411b8e68a41e247d9a8
I20260620 02:55:50.520007 700 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 02:55:50.524469 898 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 02:55:50.524602 898 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 02:55:50.547353 883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:50.547683 883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.549747 883 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:50.551286 674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:55:50.552186 674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 0.
I20260620 02:55:50.553791 814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:50.554564 814 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 0.
I20260620 02:55:50.555411 720 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters:
I20260620 02:55:50.557994 883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:50.558178 883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:50.558290 883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:50.561964 883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.563217 674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
I20260620 02:55:50.563503 674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:50.566716 674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 1.
I20260620 02:55:50.567183 720 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters:
I20260620 02:55:50.570778 814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435"
I20260620 02:55:50.571033 814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:50.574641 814 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 1.
I20260620 02:55:50.575307 883 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:50.575531 883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:50.575666 883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Running, Role: LEADER
I20260620 02:55:50.577521 883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:50.595129 900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.595635 900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:50.604027 902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:55:50.606748 902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:55:50.626195 814 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Refusing update from remote peer 38d9721548804411b8e68a41e247d9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:50.627218 900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:50.634425 674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Refusing update from remote peer 38d9721548804411b8e68a41e247d9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:50.635257 900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:50.671486 848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.671813 848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.675630 903 mvcc.cc:205] Tried to move back new op lower bound from 7298761320934580224 to 7298761320774475776. Current Snapshot: MvccSnapshot[applied={T|T < 7298761320934580224}]
I20260620 02:55:50.679324 905 mvcc.cc:205] Tried to move back new op lower bound from 7298761320934580224 to 7298761320774475776. Current Snapshot: MvccSnapshot[applied={T|T < 7298761320934580224}]
I20260620 02:55:50.688378 883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.688690 883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:50.692821 902 catalog_manager.cc:1347] Generated new cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:50.692916 902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:55:50.693509 848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.693743 848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.709391 858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.709658 858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.714973 900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.715220 900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:50.716157 904 mvcc.cc:205] Tried to move back new op lower bound from 7298761320934580224 to 7298761320774475776. Current Snapshot: MvccSnapshot[applied={T|T < 7298761320934580224}]
I20260620 02:55:50.738051 858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:50.738355 858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:50.753294 902 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 02:55:50.755107 902 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:55:50.776576 902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Generated new TSK 0
I20260620 02:55:50.777755 902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:55:50.779445 902 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:55:50.780551 902 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260620 02:55:50.808235 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.1:0
--local_ip_for_outbound_sockets=127.0.97.1
--webserver_interface=127.0.97.1
--webserver_port=0
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260620 02:55:51.238965 912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:51.239250 912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:51.239346 912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:51.247480 912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:51.247705 912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.1
I20260620 02:55:51.256661 912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.97.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.1
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:51.257997 912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:51.259727 912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:51.273861 918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:51.274225 920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:51.274674 917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:51.275261 922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:51.275430 922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:51.275710 875 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:51.275777 875 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: loading cluster ID for follower catalog manager: success
I20260620 02:55:51.277164 922 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:51.277817 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:55:51.278491 813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:51.279111 875 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: acquiring CA information for follower catalog manager: success
I20260620 02:55:51.279175 651 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:55:51.279520 922 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:55:51.281497 875 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:55:51.282586 912 server_base.cc:1034] running on GCE node
I20260620 02:55:51.283159 912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:51.284017 912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:51.285305 912 hybrid_clock.cc:648] HybridClock initialized: now 1781924151285185 us; error 44 us; skew 500 ppm
I20260620 02:55:51.285579 912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:51.287736 912 webserver.cc:460] Webserver started at http://127.0.97.1:38531/ using document root <none> and password file <none>
I20260620 02:55:51.288357 912 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:51.288450 912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:51.288738 912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:51.291323 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data/instance:
uuid: "200c6cbcf0124308a686502d3ffd51bd"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.292084 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/instance:
uuid: "200c6cbcf0124308a686502d3ffd51bd"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.297127 912 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260620 02:55:51.300607 927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.301909 912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 02:55:51.302073 912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal
uuid: "200c6cbcf0124308a686502d3ffd51bd"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.302241 912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:51.310595 879 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:51.310695 879 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: loading cluster ID for follower catalog manager: success
I20260620 02:55:51.313298 879 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: acquiring CA information for follower catalog manager: success
I20260620 02:55:51.314953 879 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:55:51.315688 912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:51.316504 912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:51.316781 912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:51.317699 912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 02:55:51.319134 912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 02:55:51.319206 912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.319341 912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 02:55:51.319391 912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.359337 912 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.1:40979
I20260620 02:55:51.359869 1039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.1:40979 every 8 connection(s)
I20260620 02:55:51.361007 912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/data/info.pb
I20260620 02:55:51.371512 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 912
I20260620 02:55:51.371695 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/instance
I20260620 02:55:51.378381 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.2:0
--local_ip_for_outbound_sockets=127.0.97.2
--webserver_interface=127.0.97.2
--webserver_port=0
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 02:55:51.379068 1042 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:55:51.379398 1042 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.379830 1041 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:51.379983 1041 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.380302 1042 heartbeater.cc:511] Master 127.0.97.61:34445 requested a full tablet report, sending...
I20260620 02:55:51.380463 1041 heartbeater.cc:511] Master 127.0.97.62:46739 requested a full tablet report, sending...
I20260620 02:55:51.381283 1040 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:51.381851 1040 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.382254 1040 heartbeater.cc:511] Master 127.0.97.60:33171 requested a full tablet report, sending...
I20260620 02:55:51.382758 734 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:51.383700 804 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:51.383845 663 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:51.384749 734 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.1:58297
W20260620 02:55:51.779723 1050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:51.780025 1050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:51.780180 1050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:51.787513 1050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:51.787770 1050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.2
I20260620 02:55:51.798106 1050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.97.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.2
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:51.799414 1050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:51.801293 1050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:51.815105 1055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:51.815176 1056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:51.815181 1058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:51.816769 1050 server_base.cc:1034] running on GCE node
I20260620 02:55:51.817498 1050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:51.818463 1050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:51.819741 1050 hybrid_clock.cc:648] HybridClock initialized: now 1781924151819657 us; error 56 us; skew 500 ppm
I20260620 02:55:51.820070 1050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:51.822826 1050 webserver.cc:460] Webserver started at http://127.0.97.2:45953/ using document root <none> and password file <none>
I20260620 02:55:51.823509 1050 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:51.823650 1050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:51.823944 1050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:51.826702 1050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data/instance:
uuid: "880a5420b43045f4bfcf690b20dac3de"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.827491 1050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/instance:
uuid: "880a5420b43045f4bfcf690b20dac3de"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.832748 1050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260620 02:55:51.836952 1064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.838711 1050 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260620 02:55:51.838889 1050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal
uuid: "880a5420b43045f4bfcf690b20dac3de"
format_stamp: "Formatted at 2026-06-20 02:55:51 on dist-test-slave-w01b"
I20260620 02:55:51.839138 1050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:51.884294 1050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:51.885805 1050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:51.886205 1050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:51.887603 1050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 02:55:51.887889 1042 heartbeater.cc:503] Master 127.0.97.61:34445 was elected leader, sending a full tablet report...
I20260620 02:55:51.890089 1050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 02:55:51.890305 1050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.890493 1050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 02:55:51.890554 1050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:51.932936 1050 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.2:45629
I20260620 02:55:51.932955 1176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.2:45629 every 8 connection(s)
I20260620 02:55:51.934283 1050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/data/info.pb
I20260620 02:55:51.938390 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 1050
I20260620 02:55:51.938568 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/instance
I20260620 02:55:51.943387 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.3:0
--local_ip_for_outbound_sockets=127.0.97.3
--webserver_interface=127.0.97.3
--webserver_port=0
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 02:55:51.955559 1177 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:51.955890 1177 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.956136 1178 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:51.956254 1178 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.956893 1178 heartbeater.cc:511] Master 127.0.97.62:46739 requested a full tablet report, sending...
I20260620 02:55:51.956920 1177 heartbeater.cc:511] Master 127.0.97.60:33171 requested a full tablet report, sending...
I20260620 02:55:51.958600 663 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:51.959347 804 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:51.968199 1179 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:55:51.968330 1179 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:51.968717 1179 heartbeater.cc:511] Master 127.0.97.61:34445 requested a full tablet report, sending...
I20260620 02:55:51.969583 734 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:51.970363 734 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.2:39347
I20260620 02:55:52.111460 1188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:52.111742 1188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:52.113083 1188 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
I20260620 02:55:52.113776 673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:55:52.113864 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:55:52.114606 790 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:55:52.114985 1188 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:55:52.307895 1189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:52.308161 1189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:52.308935 1189 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:52.309679 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:55:52.309763 813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:52.310485 650 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:55:52.310779 1189 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 02:55:52.327136 1187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:52.327481 1187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:52.327643 1187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:52.336485 1187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:52.336719 1187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.3
I20260620 02:55:52.345983 1187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.97.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.3
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:52.347313 1187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:52.349022 1187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:52.365769 1194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:52.365748 1197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:52.369300 1195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:52.370033 1187 server_base.cc:1034] running on GCE node
I20260620 02:55:52.370951 1187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:52.372256 1187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:52.373560 1187 hybrid_clock.cc:648] HybridClock initialized: now 1781924152373466 us; error 43 us; skew 500 ppm
I20260620 02:55:52.373852 1187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:52.376267 1187 webserver.cc:460] Webserver started at http://127.0.97.3:42319/ using document root <none> and password file <none>
I20260620 02:55:52.376919 1187 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:52.377017 1187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:52.377375 1187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 02:55:52.381043 1187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data/instance:
uuid: "6f967984189c40c8afe26a19f52b782e"
format_stamp: "Formatted at 2026-06-20 02:55:52 on dist-test-slave-w01b"
I20260620 02:55:52.382301 1187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/instance:
uuid: "6f967984189c40c8afe26a19f52b782e"
format_stamp: "Formatted at 2026-06-20 02:55:52 on dist-test-slave-w01b"
I20260620 02:55:52.388440 1187 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260620 02:55:52.392527 1203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:52.394562 1187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 02:55:52.394852 1187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal
uuid: "6f967984189c40c8afe26a19f52b782e"
format_stamp: "Formatted at 2026-06-20 02:55:52 on dist-test-slave-w01b"
I20260620 02:55:52.395085 1187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:52.424492 1187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:52.425482 1187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:52.425800 1187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:52.427139 1187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 02:55:52.429642 1187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 02:55:52.429724 1187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:52.429888 1187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 02:55:52.429980 1187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:52.472924 1179 heartbeater.cc:503] Master 127.0.97.61:34445 was elected leader, sending a full tablet report...
I20260620 02:55:52.473371 1187 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.3:44643
I20260620 02:55:52.473613 1315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.3:44643 every 8 connection(s)
I20260620 02:55:52.475008 1187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/data/info.pb
I20260620 02:55:52.479929 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 1187
I20260620 02:55:52.480110 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/instance
I20260620 02:55:52.507051 1317 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:52.507134 1316 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:52.507411 1316 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:52.507411 1317 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:52.507995 1318 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:55:52.508164 1318 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:52.508913 1316 heartbeater.cc:511] Master 127.0.97.60:33171 requested a full tablet report, sending...
I20260620 02:55:52.508948 1317 heartbeater.cc:511] Master 127.0.97.62:46739 requested a full tablet report, sending...
I20260620 02:55:52.508970 1318 heartbeater.cc:511] Master 127.0.97.61:34445 requested a full tablet report, sending...
I20260620 02:55:52.510491 804 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:52.510494 734 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:52.510519 663 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:52.511248 734 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.3:33335
I20260620 02:55:52.522009 388 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 02:55:52.561868 734 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_9434fedd2eb0423f8a1ef27ed2317a8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.561745 731 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_b1b9a9040a0f45e8924d431098a21a16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.569306 725 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_273787c8398f498895aa38ce69969d53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.561517 732 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_0bcd1fedec17458682a943b527b513de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.568702 726 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_516a09a9325a415187b4537e7cca73c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.568094 727 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_e1763ffc3988490e9ab6195de0c7b01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.566172 729 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_bf2f463eec53479e84b2153a87e84612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.561956 733 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_645adfb408da4ca286f74d1aaa903c5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.565863 730 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_72ef5492c793427eb63e3ef64dafadde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:52.566835 728 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_ab16b64b7c0d434db981f8e6637ac171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 02:55:52.580977 731 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b1b9a9040a0f45e8924d431098a21a16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:52.598165 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu pid 770
I20260620 02:55:52.599447 834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 02:55:52.771464 1188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:52.771678 1188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:52.772353 1188 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
I20260620 02:55:52.772904 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu with pid 770
I20260620 02:55:52.772984 673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:55:52.774573 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
W20260620 02:55:52.799080 721 connection.cc:535] server connection from 127.0.0.1:39986 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:52.801106 648 connection.cc:535] server connection from 127.0.0.1:42446 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:52.898322 1040 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:55:52.964758 1177 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:53.001089 731 catalog_manager.cc:2148] created HMS catalog entry for table [id=5b5ee96572d24ba8938e982adfb70e92]
W20260620 02:55:53.003476 725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_273787c8398f498895aa38ce69969d53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.003490 734 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9434fedd2eb0423f8a1ef27ed2317a8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.003834 732 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0bcd1fedec17458682a943b527b513de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.003949 726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_516a09a9325a415187b4537e7cca73c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.004802 727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e1763ffc3988490e9ab6195de0c7b01c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.005733 729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bf2f463eec53479e84b2153a87e84612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.006480 733 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_645adfb408da4ca286f74d1aaa903c5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.007364 730 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_72ef5492c793427eb63e3ef64dafadde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:53.008236 728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ab16b64b7c0d434db981f8e6637ac171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:53.013171 1318 heartbeater.cc:503] Master 127.0.97.61:34445 was elected leader, sending a full tablet report...
I20260620 02:55:53.037088 734 catalog_manager.cc:2148] created HMS catalog entry for table [id=be10ca4ee654441e8b1c7344b4068f59]
W20260620 02:55:53.042858 721 consensus_peers.cc:487] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 -> Peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Couldn't send request to peer 88f31390712542bf916d639cd0e4a435. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 02:55:53.045485 1316 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:55:53.066694 731 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_b1b9a9040a0f45e8924d431098a21a16" } new_table_name: "default.Table_bc27032cc2ca40b1a29b31593c811b0c" modify_external_catalogs: true
I20260620 02:55:53.075102 726 catalog_manager.cc:2148] created HMS catalog entry for table [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:55:53.099800 734 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_9434fedd2eb0423f8a1ef27ed2317a8c" } new_table_name: "default.Table_dc643ed381634c72bbee223a230c6049" modify_external_catalogs: true
I20260620 02:55:53.110800 726 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_516a09a9325a415187b4537e7cca73c6" } new_table_name: "default.Table_639b095f095048e8891596cc4922f715" modify_external_catalogs: true
I20260620 02:55:53.120874 1250 tablet_service.cc:1467] Processing CreateTablet for tablet 883401ec08284eda96c35bfa952a8c76 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.122061 1251 tablet_service.cc:1467] Processing CreateTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.123193 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e80cb2bde6466d9ca550dc68c4490e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.130513 732 catalog_manager.cc:2148] created HMS catalog entry for table [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:55:53.131927 1111 tablet_service.cc:1467] Processing CreateTablet for tablet 883401ec08284eda96c35bfa952a8c76 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.133315 1111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883401ec08284eda96c35bfa952a8c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.133546 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883401ec08284eda96c35bfa952a8c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.137346 1112 tablet_service.cc:1467] Processing CreateTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.137984 1112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e80cb2bde6466d9ca550dc68c4490e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.151233 1385 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.155406 1385 tablet_bootstrap.cc:654] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.156781 1385 log.cc:824] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:53.157891 1386 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.162851 1386 tablet_bootstrap.cc:654] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.163614 1251 tablet_service.cc:1467] Processing CreateTablet for tablet e316c57a62fe48dda5ed06969650d418 (DEFAULT_TABLE table=default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.164028 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e316c57a62fe48dda5ed06969650d418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.164249 727 catalog_manager.cc:2148] created HMS catalog entry for table [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:55:53.171068 727 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_0bcd1fedec17458682a943b527b513de" } new_table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" modify_external_catalogs: true
I20260620 02:55:53.171809 732 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_e1763ffc3988490e9ab6195de0c7b01c" } new_table_name: "default.Table_4377b6cf14a84e548766cd36e6fc68e0" modify_external_catalogs: true
I20260620 02:55:53.169709 1110 tablet_service.cc:1467] Processing CreateTablet for tablet e316c57a62fe48dda5ed06969650d418 (DEFAULT_TABLE table=default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.174602 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e316c57a62fe48dda5ed06969650d418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.174988 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 6b564408f536421b9e3c29099badd07d (DEFAULT_TABLE table=default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.175437 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b564408f536421b9e3c29099badd07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.184532 1108 tablet_service.cc:1467] Processing CreateTablet for tablet ce94ade005a3445f951dbe761f90772f (DEFAULT_TABLE table=default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.185005 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce94ade005a3445f951dbe761f90772f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.189567 1250 tablet_service.cc:1467] Processing CreateTablet for tablet ce94ade005a3445f951dbe761f90772f (DEFAULT_TABLE table=default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.189881 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce94ade005a3445f951dbe761f90772f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.189930 971 tablet_service.cc:1467] Processing CreateTablet for tablet ce94ade005a3445f951dbe761f90772f (DEFAULT_TABLE table=default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.191377 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce94ade005a3445f951dbe761f90772f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.193487 972 tablet_service.cc:1467] Processing CreateTablet for tablet 6b564408f536421b9e3c29099badd07d (DEFAULT_TABLE table=default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.193971 972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b564408f536421b9e3c29099badd07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.193846 973 tablet_service.cc:1467] Processing CreateTablet for tablet e316c57a62fe48dda5ed06969650d418 (DEFAULT_TABLE table=default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.193873 975 tablet_service.cc:1467] Processing CreateTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.194491 973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e316c57a62fe48dda5ed06969650d418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.194747 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74e80cb2bde6466d9ca550dc68c4490e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.195397 974 tablet_service.cc:1467] Processing CreateTablet for tablet 883401ec08284eda96c35bfa952a8c76 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.195896 974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 883401ec08284eda96c35bfa952a8c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.200392 1251 tablet_service.cc:1467] Processing CreateTablet for tablet 6b564408f536421b9e3c29099badd07d (DEFAULT_TABLE table=default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.200886 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b564408f536421b9e3c29099badd07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.213416 729 catalog_manager.cc:2148] created HMS catalog entry for table [id=25c9ff9bb0dd41908835df171f4b16e0]
I20260620 02:55:53.217815 1385 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.218111 1385 ts_tablet_manager.cc:1397] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.005s
I20260620 02:55:53.219671 1386 log.cc:824] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:53.220124 729 master_service.cc:946] ReplaceTablet: received request to replace tablet 74e80cb2bde6466d9ca550dc68c4490e from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:53.232474 1385 raft_consensus.cc:348] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.232985 1385 raft_consensus.cc:374] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.233104 1385 raft_consensus.cc:729] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.233760 1388 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.234030 1385 consensus_queue.cc:260] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.238085 1251 tablet_service.cc:1467] Processing CreateTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 (DEFAULT_TABLE table=default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.238090 1108 tablet_service.cc:1467] Processing CreateTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 (DEFAULT_TABLE table=default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.238500 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0410cba3a2445a19eee5f7f599e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.238520 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0410cba3a2445a19eee5f7f599e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.229562 729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 74e80cb2bde6466d9ca550dc68c4490e
I20260620 02:55:53.242343 1388 tablet_bootstrap.cc:654] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.242599 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:43326
I20260620 02:55:53.250116 1385 ts_tablet_manager.cc:1428] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.032s user 0.019s sys 0.003s
I20260620 02:55:53.250927 1388 log.cc:824] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:53.253013 1386 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.253317 1386 ts_tablet_manager.cc:1397] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.008s
I20260620 02:55:53.254294 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:53.255666 729 catalog_manager.cc:6565] ReplaceTablet: tablet 74e80cb2bde6466d9ca550dc68c4490e deleted and replaced by tablet 41ed74eaf3e24b03b3c03296b5970753
I20260620 02:55:53.256704 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:53.257373 729 master_service.cc:946] ReplaceTablet: received request to replace tablet 74e80cb2bde6466d9ca550dc68c4490e from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:53.262099 1385 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.263949 1385 tablet_bootstrap.cc:654] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.277473 975 tablet_service.cc:1467] Processing CreateTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 (DEFAULT_TABLE table=default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.277798 1385 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.277945 1385 ts_tablet_manager.cc:1397] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260620 02:55:53.277734 1386 raft_consensus.cc:348] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.278156 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0410cba3a2445a19eee5f7f599e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.278225 1386 raft_consensus.cc:374] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.278328 1386 raft_consensus.cc:729] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.278934 1385 raft_consensus.cc:348] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.279163 1385 raft_consensus.cc:374] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.279048 1386 consensus_queue.cc:260] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.279258 1385 raft_consensus.cc:729] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.279498 1385 consensus_queue.cc:260] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
W20260620 02:55:53.281632 721 catalog_manager.cc:4821] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): delete failed for tablet 74e80cb2bde6466d9ca550dc68c4490e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74e80cb2bde6466d9ca550dc68c4490e already in progress: creating tablet
W20260620 02:55:53.282444 718 catalog_manager.cc:4821] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): delete failed for tablet 74e80cb2bde6466d9ca550dc68c4490e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74e80cb2bde6466d9ca550dc68c4490e already in progress: creating tablet
I20260620 02:55:53.287745 1386 ts_tablet_manager.cc:1428] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.034s user 0.014s sys 0.009s
I20260620 02:55:53.288075 1385 ts_tablet_manager.cc:1428] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260620 02:55:53.292218 1385 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.293474 733 catalog_manager.cc:2148] created HMS catalog entry for table [id=23215b10960e4c2ead0c74d3f999106d]
I20260620 02:55:53.294486 971 tablet_service.cc:1467] Processing CreateTablet for tablet 41ed74eaf3e24b03b3c03296b5970753 (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.294986 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41ed74eaf3e24b03b3c03296b5970753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.295516 1386 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.294390 1251 tablet_service.cc:1467] Processing CreateTablet for tablet 41ed74eaf3e24b03b3c03296b5970753 (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.296627 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41ed74eaf3e24b03b3c03296b5970753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.294056 1385 tablet_bootstrap.cc:654] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.306938 1386 tablet_bootstrap.cc:654] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.311623 733 master_service.cc:946] ReplaceTablet: received request to replace tablet 74e80cb2bde6466d9ca550dc68c4490e from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:53.312331 733 master_service.cc:946] ReplaceTablet: received request to replace tablet 74e80cb2bde6466d9ca550dc68c4490e from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:53.312855 733 master_service.cc:946] ReplaceTablet: received request to replace tablet 883401ec08284eda96c35bfa952a8c76 from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:53.313608 1385 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.313791 1385 ts_tablet_manager.cc:1397] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20260620 02:55:53.314746 1386 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.314652 1385 raft_consensus.cc:348] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.314889 1385 raft_consensus.cc:374] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.314916 1386 ts_tablet_manager.cc:1397] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260620 02:55:53.314980 1385 raft_consensus.cc:729] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.315223 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:53.315515 1394 tablet_replica.cc:330] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:53.315999 1394 raft_consensus.cc:2229] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:53.315940 1386 raft_consensus.cc:348] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.316184 1386 raft_consensus.cc:374] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.316282 1386 raft_consensus.cc:729] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.316437 1394 raft_consensus.cc:2258] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:53.316558 1386 consensus_queue.cc:260] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.318890 1386 ts_tablet_manager.cc:1428] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260620 02:55:53.319080 1394 ts_tablet_manager.cc:1905] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.320680 1386 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.322355 1386 tablet_bootstrap.cc:654] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.326738 1385 consensus_queue.cc:260] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.327378 1385 ts_tablet_manager.cc:1428] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260620 02:55:53.327767 1385 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.330201 1385 tablet_bootstrap.cc:654] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.333586 733 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 883401ec08284eda96c35bfa952a8c76
I20260620 02:55:53.334517 972 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:53.334581 1394 ts_tablet_manager.cc:1918] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 02:55:53.334829 1394 log.cc:1196] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/74e80cb2bde6466d9ca550dc68c4490e
W20260620 02:55:53.335206 718 catalog_manager.cc:4821] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): delete failed for tablet 883401ec08284eda96c35bfa952a8c76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883401ec08284eda96c35bfa952a8c76 already in progress: creating tablet
I20260620 02:55:53.335330 1394 ts_tablet_manager.cc:1939] T 74e80cb2bde6466d9ca550dc68c4490e P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:53.336009 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:53.336427 1251 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:43326
I20260620 02:55:53.336645 733 catalog_manager.cc:6565] ReplaceTablet: tablet 883401ec08284eda96c35bfa952a8c76 deleted and replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1
I20260620 02:55:53.337852 721 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet 74e80cb2bde6466d9ca550dc68c4490e (table default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]) successfully deleted
W20260620 02:55:53.341884 721 catalog_manager.cc:4821] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): delete failed for tablet 883401ec08284eda96c35bfa952a8c76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883401ec08284eda96c35bfa952a8c76 already in progress: creating tablet
I20260620 02:55:53.342788 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 41ed74eaf3e24b03b3c03296b5970753 (DEFAULT_TABLE table=default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.344691 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41ed74eaf3e24b03b3c03296b5970753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.347594 1390 raft_consensus.cc:482] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.347977 1390 raft_consensus.cc:504] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.350396 1390 leader_election.cc:288] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.355432 1110 tablet_service.cc:1467] Processing CreateTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (DEFAULT_TABLE table=default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.355840 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800b61cdbfba4a52bfd6cc885afcdbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.363021 1251 tablet_service.cc:1467] Processing CreateTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (DEFAULT_TABLE table=default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.363420 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800b61cdbfba4a52bfd6cc885afcdbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.368414 1386 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.368587 1386 ts_tablet_manager.cc:1397] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.003s
I20260620 02:55:53.365809 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883401ec08284eda96c35bfa952a8c76" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:53.369561 1386 raft_consensus.cc:348] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.369880 1386 raft_consensus.cc:374] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.369971 1386 raft_consensus.cc:729] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.370249 1386 consensus_queue.cc:260] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.370965 1386 ts_tablet_manager.cc:1428] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 02:55:53.371256 1386 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.372954 1386 tablet_bootstrap.cc:654] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
W20260620 02:55:53.374440 1204 leader_election.cc:341] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260620 02:55:53.380084 729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_bf2f463eec53479e84b2153a87e84612" } modify_external_catalogs: true
I20260620 02:55:53.380386 729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_bf2f463eec53479e84b2153a87e84612" } modify_external_catalogs: true
I20260620 02:55:53.381384 733 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_5fe1f2b14780430cb07cfd13f5ea91c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:53.382727 1249 tablet_service.cc:1467] Processing CreateTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.382725 972 tablet_service.cc:1467] Processing CreateTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.383194 972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eabbeef626e4bf28cf73b3d6184e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.383224 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eabbeef626e4bf28cf73b3d6184e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.383800 1391 tablet_replica.cc:330] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:53.384434 1391 raft_consensus.cc:2229] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:53.386583 1110 tablet_service.cc:1467] Processing CreateTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (DEFAULT_TABLE table=default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.387053 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2eabbeef626e4bf28cf73b3d6184e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.387284 1132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883401ec08284eda96c35bfa952a8c76" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.385142 1391 raft_consensus.cc:2258] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:53.388056 1385 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.388263 1385 ts_tablet_manager.cc:1397] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.027s
I20260620 02:55:53.388202 1132 raft_consensus.cc:2454] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.389170 1207 leader_election.cc:302] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd
I20260620 02:55:53.390111 1390 raft_consensus.cc:2781] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.390281 1390 raft_consensus.cc:482] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.390405 1390 raft_consensus.cc:3037] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.397648 1390 raft_consensus.cc:504] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.376864 971 tablet_service.cc:1467] Processing CreateTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (DEFAULT_TABLE table=default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.400177 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 800b61cdbfba4a52bfd6cc885afcdbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.402354 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883401ec08284eda96c35bfa952a8c76" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
W20260620 02:55:53.403012 1204 leader_election.cc:341] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260620 02:55:53.404047 1390 leader_election.cc:288] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.404137 1132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "883401ec08284eda96c35bfa952a8c76" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:53.404567 1132 raft_consensus.cc:3037] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.406634 1385 raft_consensus.cc:348] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.407445 1385 raft_consensus.cc:374] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.407764 1385 raft_consensus.cc:729] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.408547 1132 raft_consensus.cc:2454] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:53.408999 1207 leader_election.cc:302] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd
I20260620 02:55:53.408372 1385 consensus_queue.cc:260] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.409488 1390 raft_consensus.cc:2781] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.410204 1388 tablet_bootstrap.cc:492] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.410535 1388 ts_tablet_manager.cc:1397] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.177s user 0.023s sys 0.026s
I20260620 02:55:53.415195 1391 ts_tablet_manager.cc:1905] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.418460 1388 raft_consensus.cc:348] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.418859 1388 raft_consensus.cc:374] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.418973 1388 raft_consensus.cc:729] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.419662 1388 consensus_queue.cc:260] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.422001 1390 raft_consensus.cc:686] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:53.422677 1390 consensus_queue.cc:237] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.426394 1385 ts_tablet_manager.cc:1428] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.038s user 0.003s sys 0.003s
I20260620 02:55:53.430136 730 catalog_manager.cc:2148] created HMS catalog entry for table [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:55:53.433148 1385 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.436201 1385 tablet_bootstrap.cc:654] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.437661 1386 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
W20260620 02:55:53.438192 1180 tablet.cc:2369] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 02:55:53.437896 1386 ts_tablet_manager.cc:1397] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.067s user 0.022s sys 0.039s
I20260620 02:55:53.439380 730 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_1550ec9bf27b4226877f1c598bc58599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:53.440519 1386 raft_consensus.cc:348] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.441444 1386 raft_consensus.cc:374] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.441612 1386 raft_consensus.cc:729] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.441632 1391 ts_tablet_manager.cc:1918] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 02:55:53.441802 1391 log.cc:1196] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/74e80cb2bde6466d9ca550dc68c4490e
I20260620 02:55:53.442054 1386 consensus_queue.cc:260] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.442341 1391 ts_tablet_manager.cc:1939] T 74e80cb2bde6466d9ca550dc68c4490e P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:53.442689 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:53.443689 1386 ts_tablet_manager.cc:1428] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 02:55:53.444058 1386 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.444339 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:53.444595 1394 tablet_replica.cc:330] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:53.444815 1394 raft_consensus.cc:2229] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:53.445024 1394 raft_consensus.cc:2258] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 02:55:53.445564 718 catalog_manager.cc:4821] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): delete failed for tablet 74e80cb2bde6466d9ca550dc68c4490e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74e80cb2bde6466d9ca550dc68c4490e already in progress: creating tablet
I20260620 02:55:53.445899 1394 ts_tablet_manager.cc:1905] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.446358 1386 tablet_bootstrap.cc:654] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.462410 1108 tablet_service.cc:1467] Processing CreateTablet for tablet f954b0eb11a54057b3efec093f28dba7 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.462920 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f954b0eb11a54057b3efec093f28dba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.462962 971 tablet_service.cc:1467] Processing CreateTablet for tablet f954b0eb11a54057b3efec093f28dba7 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.463428 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f954b0eb11a54057b3efec093f28dba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.467072 1249 tablet_service.cc:1467] Processing CreateTablet for tablet f954b0eb11a54057b3efec093f28dba7 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.467495 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f954b0eb11a54057b3efec093f28dba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.476325 721 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet 74e80cb2bde6466d9ca550dc68c4490e (table default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]) successfully deleted
I20260620 02:55:53.476845 1391 tablet_replica.cc:330] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:53.477108 1391 raft_consensus.cc:2229] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:53.477645 1391 pending_rounds.cc:62] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Trying to abort 1 pending ops.
I20260620 02:55:53.477841 1391 pending_rounds.cc:68] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298761332427177984 op_type: NO_OP noop_request { }
I20260620 02:55:53.478104 1391 raft_consensus.cc:2866] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260620 02:55:53.478538 1319 tablet.cc:2369] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 02:55:53.479408 1391 raft_consensus.cc:2258] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:53.480551 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--webserver_interface=127.0.97.60
--webserver_port=39951
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:55:53.480901 1391 ts_tablet_manager.cc:1905] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.489501 1391 ts_tablet_manager.cc:1918] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:53.489737 1391 log.cc:1196] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/883401ec08284eda96c35bfa952a8c76
I20260620 02:55:53.490288 1391 ts_tablet_manager.cc:1939] T 883401ec08284eda96c35bfa952a8c76 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:53.492193 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:53.492604 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:53.501171 1394 ts_tablet_manager.cc:1918] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 02:55:53.501538 1394 log.cc:1196] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/883401ec08284eda96c35bfa952a8c76
I20260620 02:55:53.502951 1394 ts_tablet_manager.cc:1939] T 883401ec08284eda96c35bfa952a8c76 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:53.504633 721 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet 883401ec08284eda96c35bfa952a8c76 (table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:53.509799 721 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet 883401ec08284eda96c35bfa952a8c76 (table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:53.511926 1388 ts_tablet_manager.cc:1428] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.101s user 0.011s sys 0.000s
I20260620 02:55:53.522950 1388 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.525746 1388 tablet_bootstrap.cc:654] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.533746 1385 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.533977 1385 ts_tablet_manager.cc:1397] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.101s user 0.012s sys 0.013s
I20260620 02:55:53.534587 1386 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.534819 1386 ts_tablet_manager.cc:1397] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.091s user 0.024s sys 0.062s
I20260620 02:55:53.535027 1388 tablet_bootstrap.cc:492] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.534899 1385 raft_consensus.cc:348] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.535184 1388 ts_tablet_manager.cc:1397] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260620 02:55:53.535172 1385 raft_consensus.cc:374] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.535266 1385 raft_consensus.cc:729] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.535579 1385 consensus_queue.cc:260] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.535864 1386 raft_consensus.cc:348] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.536154 1386 raft_consensus.cc:374] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.536262 1386 raft_consensus.cc:729] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.536175 1388 raft_consensus.cc:348] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.536427 1388 raft_consensus.cc:374] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.536533 1388 raft_consensus.cc:729] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.536666 1386 consensus_queue.cc:260] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.536794 1388 consensus_queue.cc:260] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.537647 1385 ts_tablet_manager.cc:1428] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 02:55:53.538738 1385 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.539254 1386 ts_tablet_manager.cc:1428] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 02:55:53.539615 1386 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.541174 1386 tablet_bootstrap.cc:654] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.541555 1385 tablet_bootstrap.cc:654] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.544132 1388 ts_tablet_manager.cc:1428] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260620 02:55:53.548313 1388 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.550186 1388 tablet_bootstrap.cc:654] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.551548 1386 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.551734 1386 ts_tablet_manager.cc:1397] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260620 02:55:53.552464 1386 raft_consensus.cc:348] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.552742 1386 raft_consensus.cc:374] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.552871 1386 raft_consensus.cc:729] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.553136 1386 consensus_queue.cc:260] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.555117 1386 ts_tablet_manager.cc:1428] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 02:55:53.555439 1386 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.558321 1386 tablet_bootstrap.cc:654] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.560179 1388 tablet_bootstrap.cc:492] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.560377 1388 ts_tablet_manager.cc:1397] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260620 02:55:53.561090 1388 raft_consensus.cc:348] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.561375 1388 raft_consensus.cc:374] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.561468 1388 raft_consensus.cc:729] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.561771 1388 consensus_queue.cc:260] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.565416 1388 ts_tablet_manager.cc:1428] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260620 02:55:53.568166 1388 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.569938 1388 tablet_bootstrap.cc:654] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.575237 1388 tablet_bootstrap.cc:492] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.575410 1388 ts_tablet_manager.cc:1397] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260620 02:55:53.576172 1388 raft_consensus.cc:348] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.576324 728 catalog_manager.cc:2148] created HMS catalog entry for table [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:55:53.576433 1388 raft_consensus.cc:374] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.576532 1388 raft_consensus.cc:729] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.577687 1385 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.577853 1385 ts_tablet_manager.cc:1397] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.003s
I20260620 02:55:53.578159 1386 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.578382 1386 ts_tablet_manager.cc:1397] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.006s
I20260620 02:55:53.578675 1385 raft_consensus.cc:348] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.579006 1385 raft_consensus.cc:374] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.579124 1385 raft_consensus.cc:729] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.579407 1385 consensus_queue.cc:260] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.579433 1386 raft_consensus.cc:348] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.579814 1386 raft_consensus.cc:374] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.581612 1406 raft_consensus.cc:482] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.581875 1386 raft_consensus.cc:729] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.581907 1406 raft_consensus.cc:504] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } }
I20260620 02:55:53.582314 1386 consensus_queue.cc:260] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.583626 728 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 7) took 1017 ms. Trace:
I20260620 02:55:53.584546 1406 leader_election.cc:288] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.583783 728 rpcz_store.cc:276] 0620 02:55:52.566482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:52.566544 (+ 62us) service_pool.cc:227] Handling call
0620 02:55:53.008345 (+441801us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:53.008784 (+ 439us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:53.576277 (+567493us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:53.583353 (+ 7076us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 02:55:53.583475 (+ 122us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 02:55:53.583583 (+ 108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:53.577080 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 02:55:53.577209 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0620 02:55:53.577217 (+ 8us) write_op.cc:435] Acquired schema lock
0620 02:55:53.577222 (+ 5us) tablet.cc:660] Decoding operations
0620 02:55:53.577367 (+ 145us) write_op.cc:620] Acquiring the partition lock for write op
0620 02:55:53.577381 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0620 02:55:53.577386 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 02:55:53.577496 (+ 110us) tablet.cc:699] Row locks acquired
0620 02:55:53.577499 (+ 3us) write_op.cc:260] PREPARE: finished
0620 02:55:53.577541 (+ 42us) write_op.cc:270] Start()
0620 02:55:53.577580 (+ 39us) write_op.cc:276] Timestamp: P: 1781924153577477 usec, L: 0
0620 02:55:53.577584 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 02:55:53.577791 (+ 207us) log.cc:842] Serialized 432 byte log entry
0620 02:55:53.582029 (+ 4238us) op_driver.cc:444] REPLICATION: finished
0620 02:55:53.582193 (+ 164us) write_op.cc:301] APPLY: starting
0620 02:55:53.582212 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0620 02:55:53.582268 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0620 02:55:53.582300 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 02:55:53.582429 (+ 129us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 02:55:53.582470 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 02:55:53.582477 (+ 7us) write_op.cc:312] APPLY: finished
0620 02:55:53.582694 (+ 217us) log.cc:842] Serialized 28 byte log entry
0620 02:55:53.582859 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:53.582891 (+ 32us) write_op.cc:454] Released schema lock
0620 02:55:53.582902 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0620 02:55:53.582999 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:53.583005 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":420691,"Hive Metastore.run_cpu_time_us":278,"Hive Metastore.run_wall_time_us":146432,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":878,"apply.run_wall_time_us":876,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":861,"prepare.run_wall_time_us":861,"raft.queue_time_us":1051,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":271,"replication_time_us":4418}]]}
I20260620 02:55:53.586694 1386 ts_tablet_manager.cc:1428] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260620 02:55:53.587056 1386 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.588723 1386 tablet_bootstrap.cc:654] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.594717 1249 tablet_service.cc:1467] Processing CreateTablet for tablet 6acad10256014c42a04a87c7fbb0d68a (DEFAULT_TABLE table=default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.595157 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6acad10256014c42a04a87c7fbb0d68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.595916 728 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_645adfb408da4ca286f74d1aaa903c5a" } modify_external_catalogs: true
I20260620 02:55:53.596127 728 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_645adfb408da4ca286f74d1aaa903c5a" } modify_external_catalogs: true
I20260620 02:55:53.596210 971 tablet_service.cc:1467] Processing CreateTablet for tablet 6acad10256014c42a04a87c7fbb0d68a (DEFAULT_TABLE table=default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.596606 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6acad10256014c42a04a87c7fbb0d68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.598344 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 74e80cb2bde6466d9ca550dc68c4490e with delete_type TABLET_DATA_DELETED (replaced by tablet 41ed74eaf3e24b03b3c03296b5970753) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:53.598896 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:43326
I20260620 02:55:53.599900 1393 tablet_replica.cc:330] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:53.600406 1393 raft_consensus.cc:2229] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:53.600890 1393 raft_consensus.cc:2258] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:53.594530 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 6acad10256014c42a04a87c7fbb0d68a (DEFAULT_TABLE table=default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.601999 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6acad10256014c42a04a87c7fbb0d68a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 02:55:53.603544 721 catalog_manager.cc:4808] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): delete failed for tablet 883401ec08284eda96c35bfa952a8c76 because the tablet was not found. No further retry: Not found: Tablet not found: 883401ec08284eda96c35bfa952a8c76
I20260620 02:55:53.608100 1385 ts_tablet_manager.cc:1428] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260620 02:55:53.611068 1385 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.612433 1385 tablet_bootstrap.cc:654] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.614367 1393 ts_tablet_manager.cc:1905] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.614761 1388 consensus_queue.cc:260] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.615031 1396 raft_consensus.cc:482] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.615229 1396 raft_consensus.cc:504] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.616962 1388 ts_tablet_manager.cc:1428] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260620 02:55:53.617008 1396 leader_election.cc:288] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:55:53.617399 1043 tablet.cc:2369] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 02:55:53.619629 1388 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.622152 1388 tablet_bootstrap.cc:654] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.626798 1393 ts_tablet_manager.cc:1918] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 02:55:53.626973 1393 log.cc:1196] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/74e80cb2bde6466d9ca550dc68c4490e
I20260620 02:55:53.627429 1393 ts_tablet_manager.cc:1939] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:53.628455 718 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet 74e80cb2bde6466d9ca550dc68c4490e (table default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92]) successfully deleted
I20260620 02:55:53.631029 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce94ade005a3445f951dbe761f90772f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
W20260620 02:55:53.631760 1065 leader_election.cc:341] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260620 02:55:53.634022 1386 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.634222 1386 ts_tablet_manager.cc:1397] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.010s
I20260620 02:55:53.635051 1386 raft_consensus.cc:348] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.635339 1386 raft_consensus.cc:374] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.635495 1386 raft_consensus.cc:729] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.635772 1386 consensus_queue.cc:260] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.636494 1386 ts_tablet_manager.cc:1428] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 02:55:53.636886 1386 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.638352 1406 raft_consensus.cc:482] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.638620 1386 tablet_bootstrap.cc:654] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.638525 1406 raft_consensus.cc:504] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.639127 1406 leader_election.cc:288] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.640192 1388 tablet_bootstrap.cc:492] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.640388 1388 ts_tablet_manager.cc:1397] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260620 02:55:53.642199 1388 raft_consensus.cc:348] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.642506 1388 raft_consensus.cc:374] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.642598 1388 raft_consensus.cc:729] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.642786 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e316c57a62fe48dda5ed06969650d418" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:53.642928 1388 consensus_queue.cc:260] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.643349 1271 raft_consensus.cc:2454] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:53.644345 1388 ts_tablet_manager.cc:1428] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 02:55:53.644642 1388 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.646292 1388 tablet_bootstrap.cc:654] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
W20260620 02:55:53.648731 931 leader_election.cc:341] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 74e80cb2bde6466d9ca550dc68c4490e
I20260620 02:55:53.649322 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce94ade005a3445f951dbe761f90772f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:53.649552 1271 raft_consensus.cc:2454] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:53.649580 931 leader_election.cc:302] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.650076 1406 raft_consensus.cc:2781] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.650195 1406 raft_consensus.cc:482] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.650142 1068 leader_election.cc:302] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd
I20260620 02:55:53.650396 1406 raft_consensus.cc:3037] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.650616 1396 raft_consensus.cc:2781] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.650744 1396 raft_consensus.cc:482] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.650841 1396 raft_consensus.cc:3037] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.654578 1406 raft_consensus.cc:504] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.655656 1406 leader_election.cc:288] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.656554 1396 raft_consensus.cc:504] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.656606 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e316c57a62fe48dda5ed06969650d418" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:53.656840 1271 raft_consensus.cc:3037] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.657226 1396 leader_election.cc:288] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.657864 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce94ade005a3445f951dbe761f90772f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:53.658116 995 raft_consensus.cc:3037] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.660756 995 raft_consensus.cc:2454] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:53.661234 1065 leader_election.cc:302] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:53.661586 1396 raft_consensus.cc:2781] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.661628 1271 raft_consensus.cc:2454] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:53.662307 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce94ade005a3445f951dbe761f90772f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:53.662350 931 leader_election.cc:302] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.662540 1271 raft_consensus.cc:3037] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.662832 1406 raft_consensus.cc:2781] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.664707 1385 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.665215 1271 raft_consensus.cc:2454] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:53.665999 1385 ts_tablet_manager.cc:1397] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.055s user 0.006s sys 0.001s
I20260620 02:55:53.667508 1385 raft_consensus.cc:348] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.668380 1388 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.668545 1388 ts_tablet_manager.cc:1397] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260620 02:55:53.669724 1406 raft_consensus.cc:686] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:53.670388 1406 consensus_queue.cc:237] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.670892 1388 raft_consensus.cc:348] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.671119 1388 raft_consensus.cc:374] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.671226 1388 raft_consensus.cc:729] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.671468 1388 consensus_queue.cc:260] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.673420 1396 raft_consensus.cc:686] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Becoming Leader. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Running, Role: LEADER
I20260620 02:55:53.673902 1385 raft_consensus.cc:374] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.674104 1385 raft_consensus.cc:729] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.674566 1396 consensus_queue.cc:237] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.683518 725 catalog_manager.cc:2148] created HMS catalog entry for table [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:55:53.683447 1385 consensus_queue.cc:260] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.687667 1385 ts_tablet_manager.cc:1428] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260620 02:55:53.689345 1385 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.690349 725 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 10) took 1121 ms. Trace:
I20260620 02:55:53.690483 725 rpcz_store.cc:276] 0620 02:55:52.568996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:52.569059 (+ 63us) service_pool.cc:227] Handling call
0620 02:55:53.009274 (+440215us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:53.009738 (+ 464us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:53.683468 (+673730us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:53.690084 (+ 6616us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 02:55:53.690191 (+ 107us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 02:55:53.690309 (+ 118us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:53.684326 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 02:55:53.684447 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0620 02:55:53.684454 (+ 7us) write_op.cc:435] Acquired schema lock
0620 02:55:53.684456 (+ 2us) tablet.cc:660] Decoding operations
0620 02:55:53.684562 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0620 02:55:53.684578 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0620 02:55:53.684583 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 02:55:53.684676 (+ 93us) tablet.cc:699] Row locks acquired
0620 02:55:53.684678 (+ 2us) write_op.cc:260] PREPARE: finished
0620 02:55:53.684717 (+ 39us) write_op.cc:270] Start()
0620 02:55:53.684752 (+ 35us) write_op.cc:276] Timestamp: P: 1781924153684643 usec, L: 0
0620 02:55:53.684755 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 02:55:53.684931 (+ 176us) log.cc:842] Serialized 432 byte log entry
0620 02:55:53.688855 (+ 3924us) op_driver.cc:444] REPLICATION: finished
0620 02:55:53.689004 (+ 149us) write_op.cc:301] APPLY: starting
0620 02:55:53.689019 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0620 02:55:53.689063 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0620 02:55:53.689087 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 02:55:53.689232 (+ 145us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 02:55:53.689293 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 02:55:53.689300 (+ 7us) write_op.cc:312] APPLY: finished
0620 02:55:53.689385 (+ 85us) log.cc:842] Serialized 28 byte log entry
0620 02:55:53.689447 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:53.689477 (+ 30us) write_op.cc:454] Released schema lock
0620 02:55:53.689483 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 02:55:53.689535 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:53.689538 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":566218,"Hive Metastore.run_cpu_time_us":269,"Hive Metastore.run_wall_time_us":107215,"spinlock_wait_cycles":50432,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":579,"num_ops":2,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":720,"raft.queue_time_us":1494,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":224,"replication_time_us":4078}]]}
I20260620 02:55:53.691776 1385 tablet_bootstrap.cc:654] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.697068 1388 ts_tablet_manager.cc:1428] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.028s user 0.003s sys 0.003s
I20260620 02:55:53.699007 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 895f9db9d57140fda82e39b4fe631aaf (DEFAULT_TABLE table=default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.699441 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895f9db9d57140fda82e39b4fe631aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.702090 971 tablet_service.cc:1467] Processing CreateTablet for tablet 895f9db9d57140fda82e39b4fe631aaf (DEFAULT_TABLE table=default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.702474 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895f9db9d57140fda82e39b4fe631aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.704336 1249 tablet_service.cc:1467] Processing CreateTablet for tablet 895f9db9d57140fda82e39b4fe631aaf (DEFAULT_TABLE table=default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:53.704720 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895f9db9d57140fda82e39b4fe631aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:53.705411 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 883401ec08284eda96c35bfa952a8c76 with delete_type TABLET_DATA_DELETED (replaced by tablet 2eabbeef626e4bf28cf73b3d6184e1a1) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:53.705736 1393 tablet_replica.cc:330] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:53.705956 1393 raft_consensus.cc:2229] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:53.706125 1393 raft_consensus.cc:2258] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:53.707420 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e316c57a62fe48dda5ed06969650d418" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.707719 1131 raft_consensus.cc:2454] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:53.708089 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e316c57a62fe48dda5ed06969650d418" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:53.708294 1130 raft_consensus.cc:3037] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.709017 1393 ts_tablet_manager.cc:1905] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:53.711102 1130 raft_consensus.cc:2454] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
W20260620 02:55:53.711596 931 leader_election.cc:341] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Not found: Tablet not found: 74e80cb2bde6466d9ca550dc68c4490e
I20260620 02:55:53.711737 931 leader_election.cc:302] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd; no voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de
W20260620 02:55:53.711931 931 raft_consensus.cc:2670] T 74e80cb2bde6466d9ca550dc68c4490e P 200c6cbcf0124308a686502d3ffd51bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 02:55:53.716087 1385 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.716243 1385 ts_tablet_manager.cc:1397] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260620 02:55:53.717034 1385 raft_consensus.cc:348] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.717274 1385 raft_consensus.cc:374] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.717381 1385 raft_consensus.cc:729] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.717629 1385 consensus_queue.cc:260] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.719879 1385 ts_tablet_manager.cc:1428] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 02:55:53.720925 1385 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.723393 1385 tablet_bootstrap.cc:654] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.725926 1385 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.726109 1385 ts_tablet_manager.cc:1397] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260620 02:55:53.727759 1385 raft_consensus.cc:348] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.727993 1385 raft_consensus.cc:374] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.728077 1385 raft_consensus.cc:729] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.728339 1385 consensus_queue.cc:260] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.729803 1385 ts_tablet_manager.cc:1428] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 02:55:53.730907 1385 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.731539 1393 ts_tablet_manager.cc:1918] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 02:55:53.731709 1393 log.cc:1196] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/883401ec08284eda96c35bfa952a8c76
I20260620 02:55:53.732129 1393 ts_tablet_manager.cc:1939] T 883401ec08284eda96c35bfa952a8c76 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:53.732668 1385 tablet_bootstrap.cc:654] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.733206 718 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet 883401ec08284eda96c35bfa952a8c76 (table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:53.734613 1386 tablet_bootstrap.cc:492] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.735018 1386 ts_tablet_manager.cc:1397] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.098s user 0.017s sys 0.028s
I20260620 02:55:53.736035 1386 raft_consensus.cc:348] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.736429 1386 raft_consensus.cc:374] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.736570 1386 raft_consensus.cc:729] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.736976 1386 consensus_queue.cc:260] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.737731 1386 ts_tablet_manager.cc:1428] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 02:55:53.738065 1386 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.737809 725 catalog_manager.cc:5495] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:53.740145 1386 tablet_bootstrap.cc:654] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.742851 1388 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.749557 1386 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.749724 1386 ts_tablet_manager.cc:1397] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260620 02:55:53.750732 1386 raft_consensus.cc:348] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.751006 1386 raft_consensus.cc:374] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.751116 1386 raft_consensus.cc:729] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.751441 1386 consensus_queue.cc:260] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.752041 1386 ts_tablet_manager.cc:1428] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:55:53.753122 1388 tablet_bootstrap.cc:654] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.753451 1386 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.755095 1386 tablet_bootstrap.cc:654] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.765857 725 catalog_manager.cc:5495] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de reported cstate change: term changed from 0 to 1, leader changed from <none> to 880a5420b43045f4bfcf690b20dac3de (127.0.97.2). New cstate: current_term: 1 leader_uuid: "880a5420b43045f4bfcf690b20dac3de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:53.775285 1386 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.775550 1386 ts_tablet_manager.cc:1397] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.014s
I20260620 02:55:53.776474 1386 raft_consensus.cc:348] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.778992 1386 raft_consensus.cc:374] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.779137 1386 raft_consensus.cc:729] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.779502 1386 consensus_queue.cc:260] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.781294 1385 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.781455 1385 ts_tablet_manager.cc:1397] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.051s user 0.016s sys 0.021s
I20260620 02:55:53.782429 1386 ts_tablet_manager.cc:1428] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 02:55:53.782310 1385 raft_consensus.cc:348] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.782522 1385 raft_consensus.cc:374] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.782645 1385 raft_consensus.cc:729] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.782927 1385 consensus_queue.cc:260] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.783659 1388 tablet_bootstrap.cc:492] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.783882 1388 ts_tablet_manager.cc:1397] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260620 02:55:53.784679 1388 raft_consensus.cc:348] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.784981 1388 raft_consensus.cc:374] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.785110 1388 raft_consensus.cc:729] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.786291 1385 ts_tablet_manager.cc:1428] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 02:55:53.785437 1388 consensus_queue.cc:260] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.788784 1388 ts_tablet_manager.cc:1428] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 02:55:53.790078 1396 raft_consensus.cc:482] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.790256 1396 raft_consensus.cc:504] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.790899 1396 leader_election.cc:288] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.791556 1386 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:53.791750 1388 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.793329 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b564408f536421b9e3c29099badd07d" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:53.793555 1271 raft_consensus.cc:2454] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:53.794126 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b564408f536421b9e3c29099badd07d" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:53.794341 995 raft_consensus.cc:2454] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:53.795482 1386 tablet_bootstrap.cc:654] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.795921 1065 leader_election.cc:302] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:53.796193 1396 raft_consensus.cc:2781] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.796294 1396 raft_consensus.cc:482] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.796417 1396 raft_consensus.cc:3037] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.798767 1388 tablet_bootstrap.cc:654] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.799348 1396 raft_consensus.cc:504] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.800426 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b564408f536421b9e3c29099badd07d" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:53.800647 995 raft_consensus.cc:3037] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.800671 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b564408f536421b9e3c29099badd07d" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:53.800863 1271 raft_consensus.cc:3037] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.803388 995 raft_consensus.cc:2454] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:53.804034 1271 raft_consensus.cc:2454] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:53.804368 1065 leader_election.cc:302] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:53.804720 1426 raft_consensus.cc:2781] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.804750 1396 leader_election.cc:288] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.805805 725 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_c8a7ae199f32436d8fd09b4aad018b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:53.814327 1426 raft_consensus.cc:686] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Becoming Leader. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Running, Role: LEADER
I20260620 02:55:53.814723 1426 consensus_queue.cc:237] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.817437 1385 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.819175 1385 tablet_bootstrap.cc:654] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.823791 1385 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.823966 1385 ts_tablet_manager.cc:1397] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260620 02:55:53.828112 1388 tablet_bootstrap.cc:492] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.828064 1385 raft_consensus.cc:348] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.828354 1385 raft_consensus.cc:374] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.828383 1388 ts_tablet_manager.cc:1397] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.009s
I20260620 02:55:53.828440 1385 raft_consensus.cc:729] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.828711 1385 consensus_queue.cc:260] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.829502 1388 raft_consensus.cc:348] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.829897 1388 raft_consensus.cc:374] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.830034 1388 raft_consensus.cc:729] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.830319 1388 consensus_queue.cc:260] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.831837 1388 ts_tablet_manager.cc:1428] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:55:53.832145 1388 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.833106 1386 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:53.833329 1386 ts_tablet_manager.cc:1397] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.006s
I20260620 02:55:53.834337 1386 raft_consensus.cc:348] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.834659 1386 raft_consensus.cc:374] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.834791 1386 raft_consensus.cc:729] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.835093 1386 consensus_queue.cc:260] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.835749 1386 ts_tablet_manager.cc:1428] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 02:55:53.840081 1388 tablet_bootstrap.cc:654] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.841987 1385 ts_tablet_manager.cc:1428] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260620 02:55:53.845255 1385 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:53.846769 1385 tablet_bootstrap.cc:654] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.848570 1388 tablet_bootstrap.cc:492] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.848819 1388 ts_tablet_manager.cc:1397] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260620 02:55:53.849758 1388 raft_consensus.cc:348] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.850140 1388 raft_consensus.cc:374] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.850277 1388 raft_consensus.cc:729] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.850631 1388 consensus_queue.cc:260] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.853813 1388 ts_tablet_manager.cc:1428] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 02:55:53.856236 1385 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:53.856236 1388 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.856387 1385 ts_tablet_manager.cc:1397] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.002s
I20260620 02:55:53.857107 1385 raft_consensus.cc:348] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.857398 1385 raft_consensus.cc:374] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.857492 1385 raft_consensus.cc:729] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.857726 1385 consensus_queue.cc:260] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.858271 1388 tablet_bootstrap.cc:654] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.860581 1385 ts_tablet_manager.cc:1428] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 02:55:53.865023 1388 tablet_bootstrap.cc:492] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.865222 1388 ts_tablet_manager.cc:1397] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260620 02:55:53.866040 1388 raft_consensus.cc:348] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.866317 1388 raft_consensus.cc:374] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.866456 1388 raft_consensus.cc:729] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.866755 1388 consensus_queue.cc:260] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.869499 1388 ts_tablet_manager.cc:1428] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 02:55:53.871956 1388 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.873745 1388 tablet_bootstrap.cc:654] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.889894 1388 tablet_bootstrap.cc:492] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.890105 1388 ts_tablet_manager.cc:1397] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20260620 02:55:53.890926 1388 raft_consensus.cc:348] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.891204 1388 raft_consensus.cc:374] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.891309 1388 raft_consensus.cc:729] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.891566 1388 consensus_queue.cc:260] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.893038 1388 ts_tablet_manager.cc:1428] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 02:55:53.893368 1388 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:53.895319 1388 tablet_bootstrap.cc:654] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:53.913121 1390 raft_consensus.cc:482] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.913386 1390 raft_consensus.cc:504] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.914070 1390 leader_election.cc:288] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.914582 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6acad10256014c42a04a87c7fbb0d68a" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:53.914691 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6acad10256014c42a04a87c7fbb0d68a" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.914873 995 raft_consensus.cc:2454] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.914963 1130 raft_consensus.cc:2454] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.915345 1204 leader_election.cc:302] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.915784 1390 raft_consensus.cc:2781] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.915922 1390 raft_consensus.cc:482] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.916055 1390 raft_consensus.cc:3037] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.919685 1390 raft_consensus.cc:504] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.920835 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6acad10256014c42a04a87c7fbb0d68a" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:53.921063 1130 raft_consensus.cc:3037] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.921327 1388 tablet_bootstrap.cc:492] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:53.921487 1388 ts_tablet_manager.cc:1397] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.028s user 0.019s sys 0.004s
I20260620 02:55:53.922214 1388 raft_consensus.cc:348] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.922451 1388 raft_consensus.cc:374] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:53.922549 1388 raft_consensus.cc:729] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:53.922789 1388 consensus_queue.cc:260] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:53.923770 1130 raft_consensus.cc:2454] T 6acad10256014c42a04a87c7fbb0d68a P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:53.924337 1207 leader_election.cc:302] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:53.924646 1405 raft_consensus.cc:2781] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.925127 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6acad10256014c42a04a87c7fbb0d68a" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:53.925361 995 raft_consensus.cc:3037] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.926805 1388 ts_tablet_manager.cc:1428] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 02:55:53.928574 995 raft_consensus.cc:2454] T 6acad10256014c42a04a87c7fbb0d68a P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:53.931175 1390 leader_election.cc:288] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.947681 1390 raft_consensus.cc:482] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.947902 1390 raft_consensus.cc:504] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.949095 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f954b0eb11a54057b3efec093f28dba7" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:53.949365 995 raft_consensus.cc:2454] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.949762 1204 leader_election.cc:302] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.950619 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f954b0eb11a54057b3efec093f28dba7" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.950857 1130 raft_consensus.cc:2454] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.951335 1390 leader_election.cc:288] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.951622 1390 raft_consensus.cc:2781] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.951722 1390 raft_consensus.cc:482] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.951844 1390 raft_consensus.cc:3037] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.954432 1390 raft_consensus.cc:504] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.955338 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f954b0eb11a54057b3efec093f28dba7" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:53.955544 995 raft_consensus.cc:3037] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.958853 995 raft_consensus.cc:2454] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:53.959237 1204 leader_election.cc:302] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.963083 1390 leader_election.cc:288] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.963263 1390 raft_consensus.cc:2781] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:53.963405 1390 raft_consensus.cc:686] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:53.963610 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f954b0eb11a54057b3efec093f28dba7" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:53.963826 1130 raft_consensus.cc:3037] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.963670 1390 consensus_queue.cc:237] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.966634 1130 raft_consensus.cc:2454] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:53.973570 1405 raft_consensus.cc:686] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:53.974907 1405 consensus_queue.cc:237] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.990896 1390 raft_consensus.cc:482] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.991063 1390 raft_consensus.cc:504] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.991740 1390 leader_election.cc:288] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:53.992488 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eabbeef626e4bf28cf73b3d6184e1a1" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:53.992759 995 raft_consensus.cc:2454] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.993091 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eabbeef626e4bf28cf73b3d6184e1a1" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.993341 1130 raft_consensus.cc:2454] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:53.992506 1406 raft_consensus.cc:482] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:53.994676 1406 raft_consensus.cc:504] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:53.995276 1406 leader_election.cc:288] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:53.995850 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800b61cdbfba4a52bfd6cc885afcdbe6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:53.996069 1271 raft_consensus.cc:2454] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:53.996712 1204 leader_election.cc:302] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.996963 1390 raft_consensus.cc:2781] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:53.997064 1390 raft_consensus.cc:482] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:53.997138 1390 raft_consensus.cc:3037] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:53.997825 931 leader_election.cc:302] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:53.998772 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800b61cdbfba4a52bfd6cc885afcdbe6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:53.999042 1130 raft_consensus.cc:2454] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:53.999912 1390 raft_consensus.cc:504] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.000742 1406 raft_consensus.cc:2781] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:54.000885 1406 raft_consensus.cc:482] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:54.000967 1406 raft_consensus.cc:3037] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.004244 1406 raft_consensus.cc:504] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.005595 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800b61cdbfba4a52bfd6cc885afcdbe6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:54.005859 1130 raft_consensus.cc:3037] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.008678 1130 raft_consensus.cc:2454] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.009173 931 leader_election.cc:302] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:54.009512 1428 raft_consensus.cc:2781] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:54.009672 1428 raft_consensus.cc:686] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:54.009960 1428 consensus_queue.cc:237] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.011791 1427 raft_consensus.cc:482] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:54.012032 1427 raft_consensus.cc:504] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.012948 1427 leader_election.cc:288] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:54.014137 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0410cba3a2445a19eee5f7f599e2b21" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:54.014232 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0410cba3a2445a19eee5f7f599e2b21" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:54.014349 1130 raft_consensus.cc:2454] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:54.014480 1271 raft_consensus.cc:2454] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:54.014732 1390 leader_election.cc:288] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.015007 1406 leader_election.cc:288] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:54.015161 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eabbeef626e4bf28cf73b3d6184e1a1" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:54.015395 995 raft_consensus.cc:3037] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.015832 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800b61cdbfba4a52bfd6cc885afcdbe6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:54.016055 1271 raft_consensus.cc:3037] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.018805 1271 raft_consensus.cc:2454] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.020872 931 leader_election.cc:302] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:54.022374 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eabbeef626e4bf28cf73b3d6184e1a1" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:54.022641 1130 raft_consensus.cc:3037] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.024163 1406 raft_consensus.cc:2781] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:54.024520 995 raft_consensus.cc:2454] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:54.025053 1204 leader_election.cc:302] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:54.025465 1390 raft_consensus.cc:2781] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:54.025629 1390 raft_consensus.cc:686] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:54.025975 1390 consensus_queue.cc:237] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.024293 1406 raft_consensus.cc:482] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:54.028769 1406 raft_consensus.cc:3037] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.035048 1130 raft_consensus.cc:2454] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:54.035663 1406 raft_consensus.cc:504] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.036438 1406 leader_election.cc:288] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:54.037261 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0410cba3a2445a19eee5f7f599e2b21" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:54.037529 1271 raft_consensus.cc:3037] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.037993 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0410cba3a2445a19eee5f7f599e2b21" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:54.038190 1130 raft_consensus.cc:3037] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.040293 1271 raft_consensus.cc:2454] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.041688 1130 raft_consensus.cc:2454] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.043386 931 leader_election.cc:302] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:54.044003 1406 raft_consensus.cc:2781] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:54.044226 1406 raft_consensus.cc:686] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:54.045799 1406 consensus_queue.cc:237] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.100886 1390 raft_consensus.cc:482] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:54.101222 1390 raft_consensus.cc:504] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.102362 1390 leader_election.cc:288] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.102972 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41ed74eaf3e24b03b3c03296b5970753" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:54.103253 995 raft_consensus.cc:2454] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:54.103653 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41ed74eaf3e24b03b3c03296b5970753" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:54.103894 1130 raft_consensus.cc:2454] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:54.104368 1204 leader_election.cc:302] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:54.105091 1390 raft_consensus.cc:2781] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:54.105195 1390 raft_consensus.cc:482] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:54.105429 1390 raft_consensus.cc:3037] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.108116 1390 raft_consensus.cc:504] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.109154 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41ed74eaf3e24b03b3c03296b5970753" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:54.109426 995 raft_consensus.cc:3037] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.112103 995 raft_consensus.cc:2454] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:54.112564 1204 leader_election.cc:302] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:54.112864 1405 raft_consensus.cc:2781] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:54.113024 1405 raft_consensus.cc:686] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:54.113296 1405 consensus_queue.cc:237] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:54.117200 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41ed74eaf3e24b03b3c03296b5970753" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:54.117481 1130 raft_consensus.cc:3037] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.120142 1130 raft_consensus.cc:2454] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:54.123198 1390 leader_election.cc:288] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.138160 1406 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:54.138365 1406 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:54.139057 1406 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.139739 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895f9db9d57140fda82e39b4fe631aaf" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:54.139990 1271 raft_consensus.cc:2454] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:54.139948 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895f9db9d57140fda82e39b4fe631aaf" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:54.140199 1130 raft_consensus.cc:2454] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:54.140463 931 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:54.140897 1406 raft_consensus.cc:2781] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:54.141016 1406 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:54.141112 1406 raft_consensus.cc:3037] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.143891 1406 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:54.144495 1406 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.145107 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895f9db9d57140fda82e39b4fe631aaf" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:54.145157 1271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895f9db9d57140fda82e39b4fe631aaf" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:54.145377 1130 raft_consensus.cc:3037] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.145426 1271 raft_consensus.cc:3037] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:54.148352 1130 raft_consensus.cc:2454] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.148216 1271 raft_consensus.cc:2454] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:54.148998 931 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:54.149326 1406 raft_consensus.cc:2781] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:54.149467 1406 raft_consensus.cc:686] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:54.149765 1406 consensus_queue.cc:237] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:54.154258 731 catalog_manager.cc:3411] renamed table default.table_b1b9a9040a0f45e8924d431098a21a16 [id=5b5ee96572d24ba8938e982adfb70e92] in HMS: new name default.table_bc27032cc2ca40b1a29b31593c811b0c
W20260620 02:55:54.159096 733 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5fe1f2b14780430cb07cfd13f5ea91c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:54.160279 730 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1550ec9bf27b4226877f1c598bc58599 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:54.177465 896 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41ed74eaf3e24b03b3c03296b5970753 consensus state has no leader
W20260620 02:55:54.179165 725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c8a7ae199f32436d8fd09b4aad018b36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:54.180917 731 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 11) took 1115 ms. Trace:
I20260620 02:55:54.181056 731 rpcz_store.cc:276] 0620 02:55:53.065039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.066376 (+ 1337us) service_pool.cc:227] Handling call
0620 02:55:53.720818 (+654442us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:54.180218 (+459400us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:54.180557 (+ 339us) catalog_manager.cc:3616] Apply alter schema
0620 02:55:54.180867 (+ 310us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":5706,"Hive Metastore.run_cpu_time_us":1259,"Hive Metastore.run_wall_time_us":427262}
I20260620 02:55:54.183486 731 catalog_manager.cc:5495] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de reported cstate change: term changed from 0 to 1, leader changed from <none> to 880a5420b43045f4bfcf690b20dac3de (127.0.97.2). New cstate: current_term: 1 leader_uuid: "880a5420b43045f4bfcf690b20dac3de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:54.200593 731 catalog_manager.cc:5495] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:54.201519 731 catalog_manager.cc:5495] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:54.202203 731 catalog_manager.cc:5495] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:54.203369 731 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]). Expected version 1 got 0
I20260620 02:55:54.203737 731 catalog_manager.cc:5495] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:54.221306 731 catalog_manager.cc:5495] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:54.222047 731 catalog_manager.cc:5495] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:54.222611 731 catalog_manager.cc:5495] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:54.237511 731 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_93f177252a6c4a49b1c2cd213cc0e1ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:54.260567 1130 raft_consensus.cc:1261] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Refusing update from remote peer 6f967984189c40c8afe26a19f52b782e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:54.261605 1390 consensus_queue.cc:1035] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.272091 995 raft_consensus.cc:1261] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Refusing update from remote peer 6f967984189c40c8afe26a19f52b782e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:54.272995 1390 consensus_queue.cc:1035] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.276070 734 catalog_manager.cc:3411] renamed table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59] in HMS: new name default.table_dc643ed381634c72bbee223a230c6049
I20260620 02:55:54.297041 1457 mvcc.cc:205] Tried to move back new op lower bound from 7298761335840325632 to 7298761335250554880. Current Snapshot: MvccSnapshot[applied={T|T < 7298761335840325632}]
I20260620 02:55:54.300974 1459 mvcc.cc:205] Tried to move back new op lower bound from 7298761335840325632 to 7298761335250554880. Current Snapshot: MvccSnapshot[applied={T|T < 7298761335840325632}]
I20260620 02:55:54.313602 1464 tablet.cc:1722] T 41ed74eaf3e24b03b3c03296b5970753 P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:54.316286 1465 tablet.cc:1722] T 41ed74eaf3e24b03b3c03296b5970753 P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:54.310382 1463 tablet.cc:1722] T 41ed74eaf3e24b03b3c03296b5970753 P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260620 02:55:54.332367 1410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:54.332804 1410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:54.332965 1410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:54.341361 1410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:55:54.341491 1410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:54.341585 1410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:55:54.341684 1410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:55:54.357764 1410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=39951
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:54.372313 1410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:54.374989 1410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 02:55:54.413549 726 catalog_manager.cc:3411] renamed table default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b] in HMS: new name default.table_639b095f095048e8891596cc4922f715
W20260620 02:55:54.415480 1470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:54.416278 1469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:54.426476 1410 server_base.cc:1034] running on GCE node
W20260620 02:55:54.431342 1472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:54.434279 1410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:54.445528 1410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:54.446908 1410 hybrid_clock.cc:648] HybridClock initialized: now 1781924154446795 us; error 87 us; skew 500 ppm
I20260620 02:55:54.447453 1410 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:54.466028 1410 webserver.cc:460] Webserver started at http://127.0.97.60:39951/ using document root <none> and password file <none>
I20260620 02:55:54.467017 1410 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:54.467177 1410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:54.480221 1426 consensus_queue.cc:1035] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.480440 1410 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.002s sys 0.008s
I20260620 02:55:54.489353 727 catalog_manager.cc:3411] renamed table default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4] in HMS: new name default.table_b944e69346c54bf09bf73e3939fdfaba
I20260620 02:55:54.507653 1479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:54.523073 1410 fs_manager.cc:725] Time spent opening block manager: real 0.041s user 0.006s sys 0.020s
I20260620 02:55:54.524816 1480 consensus_queue.cc:1035] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.523321 1410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
uuid: "88f31390712542bf916d639cd0e4a435"
format_stamp: "Formatted at 2026-06-20 02:55:50 on dist-test-slave-w01b"
I20260620 02:55:54.525264 1410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:54.558365 1406 consensus_queue.cc:1035] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.580135 1428 consensus_queue.cc:1035] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.589893 1482 consensus_queue.cc:1035] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.596204 1426 consensus_queue.cc:1035] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.598049 1410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:54.599383 1410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:54.602217 1410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:54.613621 732 catalog_manager.cc:3411] renamed table default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14] in HMS: new name default.table_4377b6cf14a84e548766cd36e6fc68e0
I20260620 02:55:54.644560 1410 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:33171
I20260620 02:55:54.644580 1541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:33171 every 8 connection(s)
I20260620 02:55:54.646091 1410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
I20260620 02:55:54.654773 1542 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:55:54.654932 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 1410
I20260620 02:55:54.670437 1542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap starting.
I20260620 02:55:54.684403 1542 log.cc:824] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:54.706542 1542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:55:54.707211 1542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap complete.
I20260620 02:55:54.718647 1542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.719938 1542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f31390712542bf916d639cd0e4a435, State: Initialized, Role: FOLLOWER
I20260620 02:55:54.720788 1542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.741822 1546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:54.742506 1546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:54.743072 1547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:54.743343 1547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.744036 1542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:55:54.744714 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:55:54.745620 1547 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:54.767987 1517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:54.769158 1517 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 1.
I20260620 02:55:54.769958 651 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:55:54.770434 1547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 02:55:54.770548 1547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:54.770638 1547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 1 FOLLOWER]: Advancing to term 2
I20260620 02:55:54.773910 1547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.775383 744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8"
I20260620 02:55:54.776305 1547 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 election: Requested vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:54.776901 1517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435"
I20260620 02:55:54.777127 1517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 1 FOLLOWER]: Advancing to term 2
I20260620 02:55:54.784629 1517 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 2.
I20260620 02:55:54.785238 651 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:55:54.785629 1547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Leader election won for term 2
I20260620 02:55:54.786770 1547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 LEADER]: Becoming Leader. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Running, Role: LEADER
I20260620 02:55:54.788743 1390 consensus_queue.cc:1035] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.788743 1447 consensus_queue.cc:1035] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.791096 1547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.794220 1558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:54.794621 1558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:54.802991 1177 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:54.803727 1563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:55:54.808231 1563 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:55:54.813887 1563 catalog_manager.cc:669] Loaded metadata for table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]
I20260620 02:55:54.814633 1563 catalog_manager.cc:669] Loaded metadata for table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]
I20260620 02:55:54.815752 1563 catalog_manager.cc:669] Loaded metadata for table default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:55:54.816728 1563 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:55:54.817795 1563 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:55:54.819067 1563 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:55:54.820354 1563 catalog_manager.cc:669] Loaded metadata for table default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:55:54.821707 1563 catalog_manager.cc:669] Loaded metadata for table default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:55:54.822542 1563 catalog_manager.cc:669] Loaded metadata for table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:55:54.825373 1447 consensus_queue.cc:1035] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.837639 1447 consensus_queue.cc:1035] T 6acad10256014c42a04a87c7fbb0d68a P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.842557 1040 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:54.842694 1563 tablet_loader.cc:96] loaded metadata for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (table default.table_9434fedd2eb0423f8a1ef27ed2317a8c [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:55:54.845904 1563 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:55:54.848733 1563 tablet_loader.cc:96] loaded metadata for tablet 6acad10256014c42a04a87c7fbb0d68a (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:55:54.851432 1316 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:54.853922 1563 tablet_loader.cc:96] loaded metadata for tablet 6b564408f536421b9e3c29099badd07d (table default.table_0bcd1fedec17458682a943b527b513de [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:55:54.855319 1316 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:55:54.864464 1563 tablet_loader.cc:96] loaded metadata for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d])
I20260620 02:55:54.865280 1563 tablet_loader.cc:96] loaded metadata for tablet 895f9db9d57140fda82e39b4fe631aaf (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:55:54.865703 1563 tablet_loader.cc:96] loaded metadata for tablet c0410cba3a2445a19eee5f7f599e2b21 (table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0])
I20260620 02:55:54.866132 1563 tablet_loader.cc:96] loaded metadata for tablet ce94ade005a3445f951dbe761f90772f (table default.table_e1763ffc3988490e9ab6195de0c7b01c [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:55:54.866530 1563 tablet_loader.cc:96] loaded metadata for tablet e316c57a62fe48dda5ed06969650d418 (table default.table_516a09a9325a415187b4537e7cca73c6 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:55:54.866914 1563 tablet_loader.cc:96] loaded metadata for tablet f954b0eb11a54057b3efec093f28dba7 (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:55:54.867713 1563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:55:54.869439 674 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 LEADER]: Rejecting Update request from peer 38d9721548804411b8e68a41e247d9a8 for earlier term 1. Current term is 2. Ops: []
I20260620 02:55:54.877611 1370 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 }, Status: INVALID_TERM, Last received: 1.35, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260620 02:55:54.878618 1563 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:54.878736 1563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:55:54.880613 1563 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:55:54.889741 1370 consensus_queue.cc:1225] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Peer 7e68099b11fb4e71a63f9749ec9da6bf log is divergent from this leader: its last log entry 2.36 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 35
I20260620 02:55:54.890182 1568 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 02:55:54.890391 1568 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Running, Role: LEADER
I20260620 02:55:54.890851 1568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:54.891623 1568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 02:55:54.892000 1563 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Loaded TSK: 0
I20260620 02:55:54.898304 1563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:55:54.889667 1572 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 02:55:54.913520 1563 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:55:54.919682 1563 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 11
I20260620 02:55:54.945598 1428 consensus_queue.cc:1035] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.965909 1507 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:33107; Asking this server to re-register.
I20260620 02:55:54.967103 1177 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:54.969273 1507 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:54.976799 1406 consensus_queue.cc:1035] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:54.977485 1178 heartbeater.cc:503] Master 127.0.97.62:46739 was elected leader, sending a full tablet report...
I20260620 02:55:54.985440 1507 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:59587; Asking this server to re-register.
I20260620 02:55:54.986680 1040 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:54.988148 1507 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:55.001573 1507 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:38123; Asking this server to re-register.
I20260620 02:55:55.002519 1316 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:55.004262 1317 heartbeater.cc:503] Master 127.0.97.62:46739 was elected leader, sending a full tablet report...
I20260620 02:55:55.006060 1507 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:55.011397 1517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Refusing update from remote peer 7e68099b11fb4e71a63f9749ec9da6bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 37. (index mismatch)
I20260620 02:55:55.011804 744 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Refusing update from remote peer 7e68099b11fb4e71a63f9749ec9da6bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 2 index: 37. (index mismatch)
I20260620 02:55:55.012454 1558 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 02:55:55.013854 1558 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260620 02:55:55.031243 1568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.031575 1568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:55.032804 1390 consensus_queue.cc:1035] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 02:55:55.049258 1568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.049659 1568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:55.054240 1547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.054535 1547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:55.055223 663 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92] alter complete (version 1)
I20260620 02:55:55.067721 1447 consensus_queue.cc:1035] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:55.070279 1041 heartbeater.cc:503] Master 127.0.97.62:46739 was elected leader, sending a full tablet report...
I20260620 02:55:55.106164 1406 consensus_queue.cc:1035] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:55.119514 1546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.119836 1546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:55.129312 1558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.129623 1558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:55.130883 1428 consensus_queue.cc:1035] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:55.131170 1546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:55.131410 1546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:55.158903 1406 consensus_queue.cc:1035] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:55.176188 1596 consensus_queue.cc:1035] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:55.181551 898 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:55:55.213770 1580 mvcc.cc:205] Tried to move back new op lower bound from 7298761338915737600 to 7298761338029367296. Current Snapshot: MvccSnapshot[applied={T|T < 7298761335707516928}]
I20260620 02:55:55.348703 729 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]
I20260620 02:55:55.363052 1605 tablet.cc:1722] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.370134 664 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:55.370150 1606 tablet.cc:1722] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.370911 1607 tablet.cc:1722] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.388293 664 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59] alter complete (version 1)
I20260620 02:55:55.391235 1605 tablet.cc:1722] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.396031 1607 tablet.cc:1722] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.404388 1606 tablet.cc:1722] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.421033 663 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b] alter complete (version 1)
I20260620 02:55:55.449502 663 catalog_manager.cc:5587] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629) does not have the latest schema for tablet 6b564408f536421b9e3c29099badd07d (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]). Expected version 1 got 0
I20260620 02:55:55.450959 1605 tablet.cc:1722] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.463156 1606 tablet.cc:1722] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.463184 1608 tablet.cc:1722] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.465936 663 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4] alter complete (version 1)
I20260620 02:55:55.471235 664 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet e316c57a62fe48dda5ed06969650d418 (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:55.471675 1606 tablet.cc:1722] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.476123 1608 tablet.cc:1722] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.482059 663 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14] alter complete (version 1)
I20260620 02:55:55.484038 1605 tablet.cc:1722] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:55.493314 733 catalog_manager.cc:2148] created HMS catalog entry for table [id=11ef599466fd441383a02104dd781ffb]
W20260620 02:55:55.494176 733 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
I20260620 02:55:55.523726 730 catalog_manager.cc:2148] created HMS catalog entry for table [id=7575317988be47d9944b5e96914ec04b]
W20260620 02:55:55.524598 730 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
I20260620 02:55:55.578841 728 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]
I20260620 02:55:55.627673 725 catalog_manager.cc:2148] created HMS catalog entry for table [id=5e660bb5b5714ca18f28d2b64ccaea86]
W20260620 02:55:55.628584 725 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
W20260620 02:55:55.655887 896 catalog_manager.cc:3810] Illegal state: an error occurred while updating the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
W20260620 02:55:55.656281 896 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 12 ALTER_TABLE default.table_dc643ed381634c72bbee223a230c6049: Illegal state: an error occurred while updating the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
W20260620 02:55:55.656481 896 hms_notification_log_listener.cc:134] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER
I20260620 02:55:55.657516 731 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 26) took 2286 ms. Trace:
I20260620 02:55:55.657670 731 rpcz_store.cc:276] 0620 02:55:53.371196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:54.237220 (+866024us) service_pool.cc:227] Handling call
0620 02:55:55.657458 (+1420238us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.657785 726 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 13) took 2547 ms. Trace:
I20260620 02:55:55.657900 726 rpcz_store.cc:276] 0620 02:55:53.110529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.110591 (+ 62us) service_pool.cc:227] Handling call
0620 02:55:54.157941 (+1047350us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.657300 (+1499359us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.657488 (+ 188us) catalog_manager.cc:3616] Apply alter schema
0620 02:55:55.657744 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":116602,"Hive Metastore.run_cpu_time_us":878,"Hive Metastore.run_wall_time_us":138671,"mutex_wait_us":24}
W20260620 02:55:55.658179 731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:58297 (request call id 12) took 1367 ms (client timeout 1000 ms). Trace:
W20260620 02:55:55.658291 726 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:39347 (request call id 15) took 1352 ms (client timeout 1000 ms). Trace:
W20260620 02:55:55.658319 731 rpcz_store.cc:269] 0620 02:55:54.290838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.657982 (+1367144us) service_pool.cc:214] Skipping call since client already timed out
0620 02:55:55.658136 (+ 154us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260620 02:55:55.658401 726 rpcz_store.cc:269] 0620 02:55:54.306259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.658216 (+1351957us) service_pool.cc:214] Skipping call since client already timed out
0620 02:55:55.658250 (+ 34us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260620 02:55:55.658634 726 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.3:33335 (request call id 15) took 1343 ms (client timeout 1000 ms). Trace:
W20260620 02:55:55.658728 726 rpcz_store.cc:269] 0620 02:55:54.315024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.658572 (+1343548us) service_pool.cc:214] Skipping call since client already timed out
0620 02:55:55.658600 (+ 28us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260620 02:55:55.660140 731 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 27) took 2288 ms. Trace:
I20260620 02:55:55.660269 731 rpcz_store.cc:276] 0620 02:55:53.371634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.659768 (+2288134us) service_pool.cc:227] Handling call
0620 02:55:55.660095 (+ 327us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.660799 731 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 28) took 2239 ms. Trace:
I20260620 02:55:55.660907 731 rpcz_store.cc:276] 0620 02:55:53.421818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.660421 (+2238603us) service_pool.cc:227] Handling call
0620 02:55:55.660761 (+ 340us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.661123 731 master_service.cc:946] ReplaceTablet: received request to replace tablet ce94ade005a3445f951dbe761f90772f from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:55.661273 727 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 14) took 2490 ms. Trace:
I20260620 02:55:55.661377 727 rpcz_store.cc:276] 0620 02:55:53.170854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.170910 (+ 56us) service_pool.cc:227] Handling call
0620 02:55:54.158159 (+987249us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.660774 (+1502615us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.661002 (+ 228us) catalog_manager.cc:3616] Apply alter schema
0620 02:55:55.661211 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":255141,"Hive Metastore.run_cpu_time_us":794,"Hive Metastore.run_wall_time_us":75706}
I20260620 02:55:55.661635 727 master_service.cc:946] ReplaceTablet: received request to replace tablet c0410cba3a2445a19eee5f7f599e2b21 from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:55.662703 732 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 15) took 2491 ms. Trace:
I20260620 02:55:55.662809 732 rpcz_store.cc:276] 0620 02:55:53.171606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.171657 (+ 51us) service_pool.cc:227] Handling call
0620 02:55:54.158397 (+986740us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.661868 (+1503471us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.662433 (+ 565us) catalog_manager.cc:3616] Apply alter schema
0620 02:55:55.662634 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":331053,"Hive Metastore.run_cpu_time_us":765,"Hive Metastore.run_wall_time_us":123948}
I20260620 02:55:55.663378 729 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56978 (request call id 21) took 2442 ms. Trace:
I20260620 02:55:55.663460 729 rpcz_store.cc:276] 0620 02:55:53.221355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.379819 (+158464us) service_pool.cc:227] Handling call
0620 02:55:54.158568 (+778749us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.663332 (+1504764us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":454851,"Hive Metastore.run_cpu_time_us":812,"Hive Metastore.run_wall_time_us":734774}
I20260620 02:55:55.663755 729 master_service.cc:946] ReplaceTablet: received request to replace tablet c0410cba3a2445a19eee5f7f599e2b21 from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:55.664019 728 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56978 (request call id 24) took 2353 ms. Trace:
I20260620 02:55:55.664086 728 rpcz_store.cc:276] 0620 02:55:53.311030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.595759 (+284729us) service_pool.cc:227] Handling call
0620 02:55:54.160983 (+565224us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.663981 (+1502998us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1362431,"Hive Metastore.run_cpu_time_us":220,"Hive Metastore.run_wall_time_us":55014}
W20260620 02:55:55.664166 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.61:34445)
I20260620 02:55:55.664322 728 master_service.cc:946] ReplaceTablet: received request to replace tablet 2eabbeef626e4bf28cf73b3d6184e1a1 from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:55.664952 734 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 12) took 2588 ms. Trace:
I20260620 02:55:55.665056 734 rpcz_store.cc:276] 0620 02:55:53.076424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.076469 (+ 45us) service_pool.cc:227] Handling call
0620 02:55:53.099730 (+ 23261us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abee0586 00007fb9a31d3de6 00007fb9a31d3b15 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:54.157941 (+1058211us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.656977 (+1499036us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 02:55:55.664716 (+ 7739us) catalog_manager.cc:3616] Apply alter schema
0620 02:55:55.664924 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6504,"Hive Metastore.run_cpu_time_us":811,"Hive Metastore.run_wall_time_us":110030,"spinlock_wait_cycles":52491904}
I20260620 02:55:55.665452 726 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56978 (request call id 29) took 2219 ms. Trace:
I20260620 02:55:55.665549 726 rpcz_store.cc:276] 0620 02:55:53.446187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.660549 (+2214362us) service_pool.cc:227] Handling call
0620 02:55:55.665426 (+ 4877us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.665760 734 master_service.cc:946] ReplaceTablet: received request to replace tablet e316c57a62fe48dda5ed06969650d418 from {username='slave'} at 127.0.0.1:56978
W20260620 02:55:55.683235 1328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:46739)
I20260620 02:55:55.684561 734 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56978 (request call id 35) took 2143 ms. Trace:
I20260620 02:55:55.684700 734 rpcz_store.cc:276] 0620 02:55:53.541062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.665716 (+2124654us) service_pool.cc:227] Handling call
0620 02:55:55.684173 (+ 18457us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abeea527 00007fb9a31dcda7 00007fb9a31dcad5 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.684489 (+ 316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":40222592}
I20260620 02:55:55.684954 727 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56978 (request call id 31) took 2185 ms. Trace:
I20260620 02:55:55.685071 727 rpcz_store.cc:276] 0620 02:55:53.498965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.661585 (+2162620us) service_pool.cc:227] Handling call
0620 02:55:55.684619 (+ 23034us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abeea527 00007fb9a31dcda7 00007fb9a31dcad5 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.684873 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":52242176}
I20260620 02:55:55.685726 729 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56978 (request call id 33) took 2165 ms. Trace:
I20260620 02:55:55.685866 729 rpcz_store.cc:276] 0620 02:55:53.520626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.663698 (+2143072us) service_pool.cc:227] Handling call
0620 02:55:55.685454 (+ 21756us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abeea527 00007fb9a31dcda7 00007fb9a31dcad5 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.685677 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":49305344}
I20260620 02:55:55.687062 734 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 37) took 2042 ms. Trace:
I20260620 02:55:55.687156 734 rpcz_store.cc:276] 0620 02:55:53.644415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.686668 (+2042253us) service_pool.cc:227] Handling call
0620 02:55:55.687008 (+ 340us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.687322 729 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56978 (request call id 38) took 1993 ms. Trace:
I20260620 02:55:55.687453 729 rpcz_store.cc:276] 0620 02:55:53.693656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.686943 (+1993287us) service_pool.cc:227] Handling call
0620 02:55:55.687283 (+ 340us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.687628 734 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 39) took 1899 ms. Trace:
I20260620 02:55:55.687713 734 rpcz_store.cc:276] 0620 02:55:53.788554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.687315 (+1898761us) service_pool.cc:227] Handling call
0620 02:55:55.687576 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.688033 729 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 40) took 1793 ms. Trace:
I20260620 02:55:55.688195 734 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56978 (request call id 41) took 1301 ms. Trace:
I20260620 02:55:55.688299 734 rpcz_store.cc:276] 0620 02:55:54.386685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.687835 (+1301150us) service_pool.cc:227] Handling call
0620 02:55:55.688142 (+ 307us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.688738 732 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 32) took 2177 ms. Trace:
I20260620 02:55:55.688843 732 rpcz_store.cc:276] 0620 02:55:53.511756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.663053 (+2151297us) service_pool.cc:227] Handling call
0620 02:55:55.688461 (+ 25408us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abede313 00007fb9a31d0466 00007fb9a31d0195 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.688677 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":57770752}
I20260620 02:55:55.689713 728 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56978 (request call id 34) took 2168 ms. Trace:
I20260620 02:55:55.689831 728 rpcz_store.cc:276] 0620 02:55:53.521365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.664269 (+2142904us) service_pool.cc:227] Handling call
0620 02:55:55.689487 (+ 25218us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abeea527 00007fb9a31dcda7 00007fb9a31dcad5 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.689670 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":57382656}
I20260620 02:55:55.690482 726 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56978 (request call id 36) took 2103 ms. Trace:
I20260620 02:55:55.690613 726 rpcz_store.cc:276] 0620 02:55:53.587289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.666031 (+2078742us) service_pool.cc:227] Handling call
0620 02:55:55.690231 (+ 24200us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x615000033024. stack: 00007fb998ea866e 00007fb998ea8430 00007fb997f2f5ed 00000000008ea064 00000000008ea02d 00007fb9a75c127d 00007fb9a75c1373 00007fb9a43e3361 00007fb9abd5666a 00007fb9abedf2e6 00007fb9a31d2126 00007fb9a31d1e55 00007fb99f9e49be 00007fb99f9e379e 00007fb99f9e9b25 00007fb99f9ea54f
0620 02:55:55.690436 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":55015808}
I20260620 02:55:55.688172 729 rpcz_store.cc:276] 0620 02:55:53.894294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.687661 (+1793367us) service_pool.cc:227] Handling call
0620 02:55:55.687987 (+ 326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.700971 731 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:56978 (request call id 30) took 2202 ms. Trace:
I20260620 02:55:55.701869 731 rpcz_store.cc:276] 0620 02:55:53.498832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.661054 (+2162222us) service_pool.cc:227] Handling call
0620 02:55:55.700898 (+ 39844us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 02:55:55.704996 663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_25240b69cc014c1d839a035fc97f6736"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.705991 664 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_93f177252a6c4a49b1c2cd213cc0e1ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.706972 662 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_4ee5e7edf7f74bf8890817d8bc65111c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 02:55:55.709466 1328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:46739)
I20260620 02:55:55.711562 876 catalog_manager.cc:2709] Deleting table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0] in response to Hive Metastore notification log event 16
W20260620 02:55:55.717875 1328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:46739)
I20260620 02:55:55.720388 876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet c0410cba3a2445a19eee5f7f599e2b21
I20260620 02:55:55.721830 661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:55:55.722069 661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:55:55.722527 876 catalog_manager.cc:2709] Deleting table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d] in response to Hive Metastore notification log event 19
I20260620 02:55:55.724282 971 tablet_service.cc:1514] Processing DeleteTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:32806
I20260620 02:55:55.725135 1621 tablet_replica.cc:330] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:55.725175 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:40670
I20260620 02:55:55.725219 1249 tablet_service.cc:1514] Processing DeleteTablet for tablet c0410cba3a2445a19eee5f7f599e2b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:43328
I20260620 02:55:55.725428 1621 raft_consensus.cc:2229] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:55.726094 1621 raft_consensus.cc:2258] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.727121 1621 ts_tablet_manager.cc:1905] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.735357 1621 ts_tablet_manager.cc:1918] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:55.735587 1621 log.cc:1196] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/c0410cba3a2445a19eee5f7f599e2b21
I20260620 02:55:55.736129 1621 ts_tablet_manager.cc:1939] T c0410cba3a2445a19eee5f7f599e2b21 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:55.737447 648 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet c0410cba3a2445a19eee5f7f599e2b21 (table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]) successfully deleted
I20260620 02:55:55.740329 876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet 800b61cdbfba4a52bfd6cc885afcdbe6
I20260620 02:55:55.741070 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:32806
I20260620 02:55:55.741489 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:40670
I20260620 02:55:55.741627 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 800b61cdbfba4a52bfd6cc885afcdbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 02:55:55 UTC) from {username='slave'} at 127.0.0.1:43328
I20260620 02:55:55.741932 1621 tablet_replica.cc:330] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:55.742206 1621 raft_consensus.cc:2229] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:55.742588 1621 raft_consensus.cc:2258] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.743750 1621 ts_tablet_manager.cc:1905] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.751960 1621 ts_tablet_manager.cc:1918] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:55.752228 1621 log.cc:1196] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/800b61cdbfba4a52bfd6cc885afcdbe6
I20260620 02:55:55.752718 1621 ts_tablet_manager.cc:1939] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:55.753944 648 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]) successfully deleted
W20260620 02:55:55.754468 663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_25240b69cc014c1d839a035fc97f6736 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:55.758627 660 master_service.cc:946] ReplaceTablet: received request to replace tablet e316c57a62fe48dda5ed06969650d418 from {username='slave'} at 127.0.0.1:38692
I20260620 02:55:55.760341 659 master_service.cc:946] ReplaceTablet: received request to replace tablet c0410cba3a2445a19eee5f7f599e2b21 from {username='slave'} at 127.0.0.1:38692
I20260620 02:55:55.764345 659 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_7f746bb2ed874273ae6e2d78b8379fab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.765373 658 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_e5280ce916eb4d49906c6fe188573c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.766266 657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:55:55.766451 660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet e316c57a62fe48dda5ed06969650d418
I20260620 02:55:55.766604 657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:55:55.766987 660 catalog_manager.cc:6565] ReplaceTablet: tablet e316c57a62fe48dda5ed06969650d418 deleted and replaced by tablet ddb0e69b345a4b728949a6ff9cc3bd6f
I20260620 02:55:55.767210 660 master_service.cc:946] ReplaceTablet: received request to replace tablet 2eabbeef626e4bf28cf73b3d6184e1a1 from {username='slave'} at 127.0.0.1:38692
I20260620 02:55:55.767920 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet e316c57a62fe48dda5ed06969650d418 with delete_type TABLET_DATA_DELETED (replaced by tablet ddb0e69b345a4b728949a6ff9cc3bd6f) from {username='slave'} at 127.0.0.1:40670
I20260620 02:55:55.769680 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet e316c57a62fe48dda5ed06969650d418 with delete_type TABLET_DATA_DELETED (replaced by tablet ddb0e69b345a4b728949a6ff9cc3bd6f) from {username='slave'} at 127.0.0.1:43328
I20260620 02:55:55.770620 655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_bc27032cc2ca40b1a29b31593c811b0c" } new_table_name: "default.Table_ab662cd82b9b4c5389924ad4ff7846b7" modify_external_catalogs: true
I20260620 02:55:55.771353 656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_101af26dd3d043d7af79c17412564fa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.772213 1623 tablet_replica.cc:330] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:55.772215 971 tablet_service.cc:1514] Processing DeleteTablet for tablet e316c57a62fe48dda5ed06969650d418 with delete_type TABLET_DATA_DELETED (replaced by tablet ddb0e69b345a4b728949a6ff9cc3bd6f) from {username='slave'} at 127.0.0.1:32806
I20260620 02:55:55.775094 1621 tablet_replica.cc:330] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:55.775383 1621 raft_consensus.cc:2229] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:55.775890 1621 raft_consensus.cc:2258] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.777348 1621 ts_tablet_manager.cc:1905] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.780922 971 tablet_service.cc:1467] Processing CreateTablet for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (DEFAULT_TABLE table=default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.781554 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb0e69b345a4b728949a6ff9cc3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.786000 1621 ts_tablet_manager.cc:1918] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:55.786259 1621 log.cc:1196] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/e316c57a62fe48dda5ed06969650d418
I20260620 02:55:55.786892 1621 ts_tablet_manager.cc:1939] T e316c57a62fe48dda5ed06969650d418 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:55.788183 648 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet e316c57a62fe48dda5ed06969650d418 (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]) successfully deleted
I20260620 02:55:55.790289 1108 tablet_service.cc:1467] Processing CreateTablet for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (DEFAULT_TABLE table=default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.790717 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb0e69b345a4b728949a6ff9cc3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.794063 660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet 2eabbeef626e4bf28cf73b3d6184e1a1
I20260620 02:55:55.794456 660 catalog_manager.cc:6565] ReplaceTablet: tablet 2eabbeef626e4bf28cf73b3d6184e1a1 deleted and replaced by tablet 0b621af903534b51b89d0bc0e5f555f8
I20260620 02:55:55.794780 660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:55:55.795394 660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:55:55.795657 1112 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b621af903534b51b89d0bc0e5f555f8) from {username='slave'} at 127.0.0.1:40670
I20260620 02:55:55.796635 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b621af903534b51b89d0bc0e5f555f8) from {username='slave'} at 127.0.0.1:32806
I20260620 02:55:55.796978 1621 tablet_replica.cc:330] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:55.797289 1621 raft_consensus.cc:2229] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:55.797547 1621 raft_consensus.cc:2258] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.798599 1621 ts_tablet_manager.cc:1905] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.809790 975 tablet_service.cc:1467] Processing CreateTablet for tablet 0b621af903534b51b89d0bc0e5f555f8 (DEFAULT_TABLE table=default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.810289 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b621af903534b51b89d0bc0e5f555f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.810402 1625 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:55.810597 1621 ts_tablet_manager.cc:1918] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:55.810758 1621 log.cc:1196] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/2eabbeef626e4bf28cf73b3d6184e1a1
I20260620 02:55:55.811597 1621 ts_tablet_manager.cc:1939] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:55.812733 648 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:55.813072 1625 tablet_bootstrap.cc:654] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.814775 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 0b621af903534b51b89d0bc0e5f555f8 (DEFAULT_TABLE table=default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.815281 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b621af903534b51b89d0bc0e5f555f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.827977 1627 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:55.828451 1622 tablet_replica.cc:330] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:55.829253 1622 raft_consensus.cc:2229] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:55.831465 1627 tablet_bootstrap.cc:654] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.831774 1622 raft_consensus.cc:2258] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.790309 1250 tablet_service.cc:1467] Processing CreateTablet for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (DEFAULT_TABLE table=default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.795161 1251 tablet_service.cc:1514] Processing DeleteTablet for tablet 2eabbeef626e4bf28cf73b3d6184e1a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 0b621af903534b51b89d0bc0e5f555f8) from {username='slave'} at 127.0.0.1:43328
I20260620 02:55:55.814620 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 0b621af903534b51b89d0bc0e5f555f8 (DEFAULT_TABLE table=default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.834115 1623 raft_consensus.cc:2229] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:55.834657 1623 raft_consensus.cc:2258] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.835704 1623 ts_tablet_manager.cc:1905] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.836210 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb0e69b345a4b728949a6ff9cc3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.842696 1622 ts_tablet_manager.cc:1905] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.843109 1627 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:55.843251 1627 ts_tablet_manager.cc:1397] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260620 02:55:55.844573 1627 raft_consensus.cc:348] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.844807 1627 raft_consensus.cc:374] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:55.844897 1627 raft_consensus.cc:729] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:55.845218 1627 consensus_queue.cc:260] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.845585 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b621af903534b51b89d0bc0e5f555f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.846621 1627 ts_tablet_manager.cc:1428] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 02:55:55.847098 1627 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:55.848546 1627 tablet_bootstrap.cc:654] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.856340 1625 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:55.856976 1625 ts_tablet_manager.cc:1397] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
I20260620 02:55:55.858067 1625 raft_consensus.cc:348] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:55.858376 1625 raft_consensus.cc:374] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:55.858505 1625 raft_consensus.cc:729] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:55.860419 1625 consensus_queue.cc:260] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:55.861590 1625 ts_tablet_manager.cc:1428] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 02:55:55.876921 1625 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:55.878687 1625 tablet_bootstrap.cc:654] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.887176 1630 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:55.907097 1625 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:55.907372 1625 ts_tablet_manager.cc:1397] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.010s
I20260620 02:55:55.908262 1625 raft_consensus.cc:348] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.908582 1625 raft_consensus.cc:374] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:55.908715 1625 raft_consensus.cc:729] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:55.909035 1625 consensus_queue.cc:260] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.914263 1625 ts_tablet_manager.cc:1428] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 02:55:55.916554 1622 ts_tablet_manager.cc:1918] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:55.917443 1630 tablet_bootstrap.cc:654] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.927598 733 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=11ef599466fd441383a02104dd781ffb]
I20260620 02:55:55.927772 1623 ts_tablet_manager.cc:1918] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:55.927954 1623 log.cc:1196] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/c0410cba3a2445a19eee5f7f599e2b21
I20260620 02:55:55.928139 733 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 22) took 2662 ms. Trace:
I20260620 02:55:55.928524 1623 ts_tablet_manager.cc:1939] T c0410cba3a2445a19eee5f7f599e2b21 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:55.928296 733 rpcz_store.cc:276] 0620 02:55:53.265177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.381137 (+115960us) service_pool.cc:227] Handling call
0620 02:55:54.159228 (+778091us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:54.159778 (+ 550us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:55.493234 (+1333456us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:55.494047 (+ 813us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.494051 (+ 4us) write_op.cc:454] Released schema lock
0620 02:55:55.494275 (+ 224us) catalog_manager.cc:2155] Rolling back HMS table creation
0620 02:55:55.928084 (+433809us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:55.493947 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER)
0620 02:55:55.493964 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.493970 (+ 6us) write_op.cc:454] Released schema lock
0620 02:55:55.493974 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1336848,"Hive Metastore.run_cpu_time_us":556,"Hive Metastore.run_wall_time_us":428956,"child_traces":[["op",{}]]}
I20260620 02:55:55.930352 651 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet c0410cba3a2445a19eee5f7f599e2b21 (table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]) successfully deleted
I20260620 02:55:55.930734 1623 tablet_replica.cc:330] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:55.931017 1623 raft_consensus.cc:2229] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:55.931236 1623 raft_consensus.cc:2258] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.933493 663 catalog_manager.cc:2148] created HMS catalog entry for table [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:55:55.935542 1622 log.cc:1196] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/c0410cba3a2445a19eee5f7f599e2b21
I20260620 02:55:55.936334 1622 ts_tablet_manager.cc:1939] T c0410cba3a2445a19eee5f7f599e2b21 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:55.937384 651 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet c0410cba3a2445a19eee5f7f599e2b21 (table default.table_bf2f463eec53479e84b2153a87e84612 [id=25c9ff9bb0dd41908835df171f4b16e0]) successfully deleted
I20260620 02:55:55.937686 1622 tablet_replica.cc:330] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:55.937892 1622 raft_consensus.cc:2229] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:55.938113 1622 raft_consensus.cc:2258] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:55.938982 1622 ts_tablet_manager.cc:1905] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.939882 876 catalog_manager.cc:2709] Deleting table default.table_5fe1f2b14780430cb07cfd13f5ea91c2 [id=11ef599466fd441383a02104dd781ffb] in response to Hive Metastore notification log event 21
W20260620 02:55:55.940157 876 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 21 DROP_TABLE default.table_5fe1f2b14780430cb07cfd13f5ea91c2: Not found: the table does not exist: table_id: "11ef599466fd441383a02104dd781ffb" table_name: "default.table_5fe1f2b14780430cb07cfd13f5ea91c2"
I20260620 02:55:55.951519 1572 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
W20260620 02:55:55.953300 664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_93f177252a6c4a49b1c2cd213cc0e1ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:55.953709 662 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4ee5e7edf7f74bf8890817d8bc65111c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:55.956152 1572 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: loading cluster ID for follower catalog manager: success
W20260620 02:55:55.959118 659 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7f746bb2ed874273ae6e2d78b8379fab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:55.959534 658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e5280ce916eb4d49906c6fe188573c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 02:55:55.960043 656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_101af26dd3d043d7af79c17412564fa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 02:55:55.967619 975 tablet_service.cc:1467] Processing CreateTablet for tablet 60d4ef253c6f4e5397187e78231b5503 (DEFAULT_TABLE table=default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.968113 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d4ef253c6f4e5397187e78231b5503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.969183 663 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:55.970268 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 60d4ef253c6f4e5397187e78231b5503 (DEFAULT_TABLE table=default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.970677 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d4ef253c6f4e5397187e78231b5503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 02:55:55.971484 663 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0b621af903534b51b89d0bc0e5f555f8 consensus state has no leader
I20260620 02:55:55.972410 663 catalog_manager.cc:5587] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
W20260620 02:55:55.972865 663 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ddb0e69b345a4b728949a6ff9cc3bd6f consensus state has no leader
I20260620 02:55:55.973127 663 master_service.cc:946] ReplaceTablet: received request to replace tablet c0410cba3a2445a19eee5f7f599e2b21 from {username='slave'} at 127.0.0.1:38692
I20260620 02:55:55.976948 1572 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: acquiring CA information for follower catalog manager: success
I20260620 02:55:55.978556 663 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:55.979681 663 catalog_manager.cc:5587] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:55.981063 1625 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:55.982729 1625 tablet_bootstrap.cc:654] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.988003 1630 tablet_bootstrap.cc:492] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:55.988163 1630 ts_tablet_manager.cc:1397] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.002s
I20260620 02:55:55.988380 663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:55.988940 1630 raft_consensus.cc:348] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.989177 1630 raft_consensus.cc:374] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:55.989282 1630 raft_consensus.cc:729] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:55.989533 1630 consensus_queue.cc:260] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.990144 1630 ts_tablet_manager.cc:1428] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 02:55:55.990643 1623 ts_tablet_manager.cc:1905] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:55.970014 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 60d4ef253c6f4e5397187e78231b5503 (DEFAULT_TABLE table=default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:55.993290 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d4ef253c6f4e5397187e78231b5503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:55.996317 1630 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:55.998010 1630 tablet_bootstrap.cc:654] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:55.998342 1428 raft_consensus.cc:482] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:55.998512 1428 raft_consensus.cc:504] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:55.999083 1627 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:55.999155 1428 leader_election.cc:288] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:55.999379 1627 ts_tablet_manager.cc:1397] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.152s user 0.013s sys 0.035s
I20260620 02:55:55.999840 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b621af903534b51b89d0bc0e5f555f8" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:56.000058 1270 raft_consensus.cc:2454] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.000691 931 leader_election.cc:302] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
W20260620 02:55:56.001302 651 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0b621af903534b51b89d0bc0e5f555f8 consensus state has no leader
I20260620 02:55:56.001902 1627 raft_consensus.cc:348] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.002167 1627 raft_consensus.cc:374] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.002207 1428 raft_consensus.cc:2781] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.002254 1627 raft_consensus.cc:729] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.002367 1428 raft_consensus.cc:482] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.002493 1428 raft_consensus.cc:3037] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.002524 1627 consensus_queue.cc:260] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.003461 1572 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:55:56.006116 1428 raft_consensus.cc:504] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.007223 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b621af903534b51b89d0bc0e5f555f8" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.007484 1131 raft_consensus.cc:2454] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.007906 1627 ts_tablet_manager.cc:1428] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260620 02:55:56.008204 1627 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.009861 1627 tablet_bootstrap.cc:654] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.010398 1623 ts_tablet_manager.cc:1918] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:56.010547 1623 log.cc:1196] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/800b61cdbfba4a52bfd6cc885afcdbe6
I20260620 02:55:56.011402 1623 ts_tablet_manager.cc:1939] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:56.012526 651 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]) successfully deleted
I20260620 02:55:56.012866 1428 leader_election.cc:288] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:56.015781 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b621af903534b51b89d0bc0e5f555f8" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.016024 1131 raft_consensus.cc:3037] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.015993 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b621af903534b51b89d0bc0e5f555f8" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:56.016213 1270 raft_consensus.cc:3037] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.019055 1270 raft_consensus.cc:2454] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.019062 1131 raft_consensus.cc:2454] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.021525 931 leader_election.cc:302] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.022125 1428 raft_consensus.cc:2781] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.022289 1428 raft_consensus.cc:686] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:56.022642 1428 consensus_queue.cc:237] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.024582 1630 tablet_bootstrap.cc:492] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.024749 1630 ts_tablet_manager.cc:1397] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.004s
I20260620 02:55:56.025589 1630 raft_consensus.cc:348] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.025835 1630 raft_consensus.cc:374] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.025924 1630 raft_consensus.cc:729] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.027437 1623 tablet_replica.cc:330] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:56.027770 1623 raft_consensus.cc:2229] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:56.027926 1627 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.028010 1623 raft_consensus.cc:2258] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.028823 1623 ts_tablet_manager.cc:1905] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.033070 1627 ts_tablet_manager.cc:1397] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260620 02:55:56.033879 1627 raft_consensus.cc:348] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.034137 1627 raft_consensus.cc:374] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.034241 1627 raft_consensus.cc:729] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.034469 1627 consensus_queue.cc:260] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.035040 1627 ts_tablet_manager.cc:1428] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 02:55:56.037590 1630 consensus_queue.cc:260] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.039170 1623 ts_tablet_manager.cc:1918] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.039321 1623 log.cc:1196] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/e316c57a62fe48dda5ed06969650d418
I20260620 02:55:56.039819 1623 ts_tablet_manager.cc:1939] T e316c57a62fe48dda5ed06969650d418 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:56.040215 1630 ts_tablet_manager.cc:1428] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260620 02:55:56.040580 1630 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.040927 651 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet e316c57a62fe48dda5ed06969650d418 (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]) successfully deleted
I20260620 02:55:56.041345 1623 tablet_replica.cc:330] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:56.041585 1623 raft_consensus.cc:2229] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:56.041998 1623 raft_consensus.cc:2258] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.042829 1630 tablet_bootstrap.cc:654] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.044220 1623 ts_tablet_manager.cc:1905] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.047572 1625 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.047731 1625 ts_tablet_manager.cc:1397] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.067s user 0.012s sys 0.003s
I20260620 02:55:56.048633 1622 ts_tablet_manager.cc:1918] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:56.048635 1625 raft_consensus.cc:348] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.048872 1622 log.cc:1196] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/800b61cdbfba4a52bfd6cc885afcdbe6
I20260620 02:55:56.048957 1625 raft_consensus.cc:374] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.049072 1625 raft_consensus.cc:729] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.049437 1622 ts_tablet_manager.cc:1939] T 800b61cdbfba4a52bfd6cc885afcdbe6 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:56.049331 1625 consensus_queue.cc:260] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.049964 1625 ts_tablet_manager.cc:1428] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 02:55:56.050877 651 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet 800b61cdbfba4a52bfd6cc885afcdbe6 (table default.table_645adfb408da4ca286f74d1aaa903c5a [id=23215b10960e4c2ead0c74d3f999106d]) successfully deleted
I20260620 02:55:56.063344 1622 tablet_replica.cc:330] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:56.063644 1622 raft_consensus.cc:2229] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:56.063935 1622 raft_consensus.cc:2258] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.066151 1623 ts_tablet_manager.cc:1918] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.066329 1623 log.cc:1196] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/2eabbeef626e4bf28cf73b3d6184e1a1
I20260620 02:55:56.066782 1623 ts_tablet_manager.cc:1939] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:56.067845 651 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:56.072270 1622 ts_tablet_manager.cc:1905] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.075042 1630 tablet_bootstrap.cc:492] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.075244 1630 ts_tablet_manager.cc:1397] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.008s
I20260620 02:55:56.076083 1630 raft_consensus.cc:348] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.076391 1630 raft_consensus.cc:374] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.076519 1630 raft_consensus.cc:729] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.076826 1630 consensus_queue.cc:260] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.080848 1630 ts_tablet_manager.cc:1428] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 02:55:56.081272 1622 ts_tablet_manager.cc:1918] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.081430 1622 log.cc:1196] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/e316c57a62fe48dda5ed06969650d418
I20260620 02:55:56.088439 1622 ts_tablet_manager.cc:1939] T e316c57a62fe48dda5ed06969650d418 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:56.089896 1622 tablet_replica.cc:330] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:56.089854 651 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet e316c57a62fe48dda5ed06969650d418 (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]) successfully deleted
I20260620 02:55:56.090173 1622 raft_consensus.cc:2229] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:56.090422 1622 raft_consensus.cc:2258] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.091593 1622 ts_tablet_manager.cc:1905] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.092507 1428 raft_consensus.cc:482] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.092746 1428 raft_consensus.cc:504] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.093672 1428 leader_election.cc:288] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.094821 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d4ef253c6f4e5397187e78231b5503" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:56.095105 1270 raft_consensus.cc:2454] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.095430 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d4ef253c6f4e5397187e78231b5503" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.095651 1131 raft_consensus.cc:2454] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.096210 931 leader_election.cc:302] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.096902 1428 raft_consensus.cc:2781] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.096999 1428 raft_consensus.cc:482] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.097107 1428 raft_consensus.cc:3037] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.100117 1428 raft_consensus.cc:504] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.101202 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d4ef253c6f4e5397187e78231b5503" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:56.101598 1270 raft_consensus.cc:3037] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.104652 1270 raft_consensus.cc:2454] T 60d4ef253c6f4e5397187e78231b5503 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.105166 931 leader_election.cc:302] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.105643 1637 raft_consensus.cc:2781] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.108328 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60d4ef253c6f4e5397187e78231b5503" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.108551 1131 raft_consensus.cc:3037] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.111223 1131 raft_consensus.cc:2454] T 60d4ef253c6f4e5397187e78231b5503 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.111963 1428 leader_election.cc:288] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.127841 1637 raft_consensus.cc:686] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:56.128383 1637 consensus_queue.cc:237] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.134372 1622 ts_tablet_manager.cc:1918] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.144475 1622 log.cc:1196] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/2eabbeef626e4bf28cf73b3d6184e1a1
I20260620 02:55:56.146257 1622 ts_tablet_manager.cc:1939] T 2eabbeef626e4bf28cf73b3d6184e1a1 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:56.147415 651 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet 2eabbeef626e4bf28cf73b3d6184e1a1 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]) successfully deleted
I20260620 02:55:56.166803 657 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:55:56.167899 730 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=7575317988be47d9944b5e96914ec04b]
I20260620 02:55:56.168264 730 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 23) took 2891 ms. Trace:
I20260620 02:55:56.168794 730 rpcz_store.cc:276] 0620 02:55:53.276911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.439171 (+162260us) service_pool.cc:227] Handling call
0620 02:55:54.160405 (+721234us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:54.160849 (+ 444us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:55.523694 (+1362845us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:55.524451 (+ 757us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.524454 (+ 3us) write_op.cc:454] Released schema lock
0620 02:55:55.524687 (+ 233us) catalog_manager.cc:2155] Rolling back HMS table creation
0620 02:55:56.168199 (+643512us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:55.524371 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER)
0620 02:55:55.524386 (+ 15us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.524395 (+ 9us) write_op.cc:454] Released schema lock
0620 02:55:55.524400 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1734483,"Hive Metastore.run_cpu_time_us":668,"Hive Metastore.run_wall_time_us":270922,"child_traces":[["op",{}]]}
I20260620 02:55:56.212993 660 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:55:56.235780 725 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=5e660bb5b5714ca18f28d2b64ccaea86]
I20260620 02:55:56.236151 725 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56978 (request call id 25) took 2924 ms. Trace:
I20260620 02:55:56.236253 725 rpcz_store.cc:276] 0620 02:55:53.311174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:53.805548 (+494374us) service_pool.cc:227] Handling call
0620 02:55:54.179295 (+373747us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:54.179811 (+ 516us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:55.627641 (+1447830us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:55.628444 (+ 803us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.628448 (+ 4us) write_op.cc:454] Released schema lock
0620 02:55:55.628685 (+ 237us) catalog_manager.cc:2155] Rolling back HMS table creation
0620 02:55:56.236090 (+607405us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:55.628362 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 38d9721548804411b8e68a41e247d9a8 is not leader of this config: current role FOLLOWER)
0620 02:55:55.628379 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:55.628387 (+ 8us) write_op.cc:454] Released schema lock
0620 02:55:55.628392 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1937600,"Hive Metastore.run_cpu_time_us":525,"Hive Metastore.run_wall_time_us":116784,"child_traces":[["op",{}]]}
I20260620 02:55:56.266935 655 catalog_manager.cc:3411] renamed table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92] in HMS: new name default.table_ab662cd82b9b4c5389924ad4ff7846b7
I20260620 02:55:56.279692 1610 raft_consensus.cc:482] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.279881 1610 raft_consensus.cc:504] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.280530 1610 leader_election.cc:288] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:56.281440 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb0e69b345a4b728949a6ff9cc3bd6f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:56.281677 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb0e69b345a4b728949a6ff9cc3bd6f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:56.281728 1270 raft_consensus.cc:2454] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:56.281911 995 raft_consensus.cc:2454] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:56.282385 1068 leader_election.cc:302] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.282639 1610 raft_consensus.cc:2781] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.282763 1610 raft_consensus.cc:482] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.282840 1610 raft_consensus.cc:3037] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.285792 1610 raft_consensus.cc:504] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.286847 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb0e69b345a4b728949a6ff9cc3bd6f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:56.287052 995 raft_consensus.cc:3037] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.290413 995 raft_consensus.cc:2454] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:56.290854 1065 leader_election.cc:302] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.292771 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb0e69b345a4b728949a6ff9cc3bd6f" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:56.292974 1270 raft_consensus.cc:3037] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.295666 1270 raft_consensus.cc:2454] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:56.296334 1610 leader_election.cc:288] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:56.296653 1610 raft_consensus.cc:2781] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.296998 1610 raft_consensus.cc:686] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Becoming Leader. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Running, Role: LEADER
I20260620 02:55:56.297441 1610 consensus_queue.cc:237] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.305186 664 catalog_manager.cc:2148] created HMS catalog entry for table [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:55:56.311801 664 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:56.312989 664 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:56.324725 975 tablet_service.cc:1467] Processing CreateTablet for tablet 4b05d8ae218e4455902714f556589aea (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.325204 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b05d8ae218e4455902714f556589aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.325139 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 4b05d8ae218e4455902714f556589aea (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.325529 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b05d8ae218e4455902714f556589aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.329576 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 4b05d8ae218e4455902714f556589aea (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.329972 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b05d8ae218e4455902714f556589aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.331977 1630 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.333705 1630 tablet_bootstrap.cc:654] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
W20260620 02:55:56.336642 1065 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:40979, user_credentials={real_user=slave}} blocked reactor thread for 45793.2us
I20260620 02:55:56.340057 1625 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.341643 1625 tablet_bootstrap.cc:654] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.342351 664 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:56.342635 664 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:56.345424 1627 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.346483 664 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:56.347146 1627 tablet_bootstrap.cc:654] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.346768 664 catalog_manager.cc:5495] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:56.347740 664 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:56.355767 664 catalog_manager.cc:5495] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:56.369221 664 catalog_manager.cc:5495] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de reported cstate change: term changed from 0 to 1, leader changed from <none> to 880a5420b43045f4bfcf690b20dac3de (127.0.97.2). New cstate: current_term: 1 leader_uuid: "880a5420b43045f4bfcf690b20dac3de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:56.369995 664 catalog_manager.cc:5587] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:56.372233 1625 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.372404 1625 ts_tablet_manager.cc:1397] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.007s
I20260620 02:55:56.374647 1625 raft_consensus.cc:348] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.374907 1625 raft_consensus.cc:374] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.374984 1625 raft_consensus.cc:729] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.375239 1625 consensus_queue.cc:260] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.376471 1627 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.376633 1627 ts_tablet_manager.cc:1397] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.008s
I20260620 02:55:56.377465 1627 raft_consensus.cc:348] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.377705 1627 raft_consensus.cc:374] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.377797 1627 raft_consensus.cc:729] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.378425 1627 consensus_queue.cc:260] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.382637 664 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]). Expected version 1 got 0
I20260620 02:55:56.383870 1630 tablet_bootstrap.cc:492] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.384099 1630 ts_tablet_manager.cc:1397] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.052s user 0.010s sys 0.006s
I20260620 02:55:56.384899 1630 raft_consensus.cc:348] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.385142 1630 raft_consensus.cc:374] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.385218 1630 raft_consensus.cc:729] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.385494 1630 consensus_queue.cc:260] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.386489 664 master_service.cc:946] ReplaceTablet: received request to replace tablet ce94ade005a3445f951dbe761f90772f from {username='slave'} at 127.0.0.1:38692
I20260620 02:55:56.389662 1630 ts_tablet_manager.cc:1428] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 02:55:56.389822 1627 ts_tablet_manager.cc:1428] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260620 02:55:56.395036 1428 raft_consensus.cc:482] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.395718 1428 raft_consensus.cc:504] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.396314 1428 leader_election.cc:288] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.397264 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b05d8ae218e4455902714f556589aea" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:56.397509 1270 raft_consensus.cc:2454] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.397846 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b05d8ae218e4455902714f556589aea" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.398080 1131 raft_consensus.cc:2454] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.398906 931 leader_election.cc:302] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.399401 1428 raft_consensus.cc:2781] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.399514 1428 raft_consensus.cc:482] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.399612 1428 raft_consensus.cc:3037] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.400779 664 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet ce94ade005a3445f951dbe761f90772f
I20260620 02:55:56.401561 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet ce94ade005a3445f951dbe761f90772f with delete_type TABLET_DATA_DELETED (replaced by tablet 7ab1a97c7336431aa30d92695629aa88) from {username='slave'} at 127.0.0.1:40670
I20260620 02:55:56.401785 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet ce94ade005a3445f951dbe761f90772f with delete_type TABLET_DATA_DELETED (replaced by tablet 7ab1a97c7336431aa30d92695629aa88) from {username='slave'} at 127.0.0.1:43328
I20260620 02:55:56.401870 1622 tablet_replica.cc:330] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:56.402096 1622 raft_consensus.cc:2229] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:56.402221 1623 tablet_replica.cc:330] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:56.402436 1623 raft_consensus.cc:2229] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:56.402667 1623 raft_consensus.cc:2258] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.403426 975 tablet_service.cc:1514] Processing DeleteTablet for tablet ce94ade005a3445f951dbe761f90772f with delete_type TABLET_DATA_DELETED (replaced by tablet 7ab1a97c7336431aa30d92695629aa88) from {username='slave'} at 127.0.0.1:32806
I20260620 02:55:56.405067 1623 ts_tablet_manager.cc:1905] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.407945 1648 tablet_replica.cc:330] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:56.408150 1648 raft_consensus.cc:2229] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:56.408340 1648 raft_consensus.cc:2258] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.409126 1648 ts_tablet_manager.cc:1905] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.411191 1428 raft_consensus.cc:504] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.412295 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b05d8ae218e4455902714f556589aea" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:56.412508 1270 raft_consensus.cc:3037] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.415138 1270 raft_consensus.cc:2454] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.415453 664 catalog_manager.cc:6565] ReplaceTablet: tablet ce94ade005a3445f951dbe761f90772f deleted and replaced by tablet 7ab1a97c7336431aa30d92695629aa88
I20260620 02:55:56.415669 1648 ts_tablet_manager.cc:1918] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.415776 1648 log.cc:1196] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/ce94ade005a3445f951dbe761f90772f
I20260620 02:55:56.415817 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 7ab1a97c7336431aa30d92695629aa88 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.416167 1648 ts_tablet_manager.cc:1939] T ce94ade005a3445f951dbe761f90772f P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:56.416237 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ab1a97c7336431aa30d92695629aa88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.419092 664 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_4377b6cf14a84e548766cd36e6fc68e0" } new_table_name: "default.Table_59f7fde270354419ba554c2cdb50b188" modify_external_catalogs: true
I20260620 02:55:56.421729 661 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:55:56.421777 648 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet ce94ade005a3445f951dbe761f90772f (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]) successfully deleted
I20260620 02:55:56.422387 975 tablet_service.cc:1467] Processing CreateTablet for tablet 7ab1a97c7336431aa30d92695629aa88 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.422752 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ab1a97c7336431aa30d92695629aa88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.415205 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 7ab1a97c7336431aa30d92695629aa88 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.426148 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ab1a97c7336431aa30d92695629aa88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.433116 1630 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.433697 931 leader_election.cc:302] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.434774 1630 tablet_bootstrap.cc:654] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.435675 1641 raft_consensus.cc:2781] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.435835 1641 raft_consensus.cc:686] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:56.436172 1641 consensus_queue.cc:237] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.436762 1428 leader_election.cc:288] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.436798 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b05d8ae218e4455902714f556589aea" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.436998 1131 raft_consensus.cc:3037] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.439110 1623 ts_tablet_manager.cc:1918] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.439214 1623 log.cc:1196] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/ce94ade005a3445f951dbe761f90772f
I20260620 02:55:56.439666 1623 ts_tablet_manager.cc:1939] T ce94ade005a3445f951dbe761f90772f P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:56.439666 1131 raft_consensus.cc:2454] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.440798 651 catalog_manager.cc:4841] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): tablet ce94ade005a3445f951dbe761f90772f (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]) successfully deleted
I20260620 02:55:56.441599 1627 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.441887 1622 raft_consensus.cc:2258] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:56.442737 1622 ts_tablet_manager.cc:1905] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:56.447311 1625 ts_tablet_manager.cc:1428] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.075s user 0.003s sys 0.000s
I20260620 02:55:56.448983 1627 tablet_bootstrap.cc:654] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.451696 1625 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.453293 1625 tablet_bootstrap.cc:654] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.449211 1622 ts_tablet_manager.cc:1918] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:56.456063 1622 log.cc:1196] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/ce94ade005a3445f951dbe761f90772f
I20260620 02:55:56.456497 1622 ts_tablet_manager.cc:1939] T ce94ade005a3445f951dbe761f90772f P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:56.459158 1625 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.459342 1625 ts_tablet_manager.cc:1397] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260620 02:55:56.460662 651 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet ce94ade005a3445f951dbe761f90772f (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]) successfully deleted
I20260620 02:55:56.460294 1625 raft_consensus.cc:348] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.461295 1625 raft_consensus.cc:374] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.461443 1625 raft_consensus.cc:729] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.461737 1625 consensus_queue.cc:260] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.465721 1625 ts_tablet_manager.cc:1428] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 02:55:56.484467 662 catalog_manager.cc:2148] created HMS catalog entry for table [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:55:56.487355 1627 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.487543 1627 ts_tablet_manager.cc:1397] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.001s
I20260620 02:55:56.488391 1627 raft_consensus.cc:348] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.488665 1627 raft_consensus.cc:374] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.488762 1627 raft_consensus.cc:729] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.490350 1627 consensus_queue.cc:260] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.490949 1627 ts_tablet_manager.cc:1428] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 02:55:56.499516 662 catalog_manager.cc:5495] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1). New cstate: current_term: 1 leader_uuid: "200c6cbcf0124308a686502d3ffd51bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:56.506809 1630 tablet_bootstrap.cc:492] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.506997 1630 ts_tablet_manager.cc:1397] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.011s
I20260620 02:55:56.507819 1630 raft_consensus.cc:348] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.508047 1630 raft_consensus.cc:374] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.508136 1630 raft_consensus.cc:729] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.508389 1630 consensus_queue.cc:260] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.512571 1630 ts_tablet_manager.cc:1428] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 02:55:56.527033 975 tablet_service.cc:1467] Processing CreateTablet for tablet 60301752658446f8a9d7102897bb1fd3 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.527521 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60301752658446f8a9d7102897bb1fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.531190 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 60301752658446f8a9d7102897bb1fd3 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.531549 662 catalog_manager.cc:5587] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629) does not have the latest schema for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]). Expected version 1 got 0
I20260620 02:55:56.531634 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60301752658446f8a9d7102897bb1fd3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 02:55:56.532213 662 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7ab1a97c7336431aa30d92695629aa88 consensus state has no leader
I20260620 02:55:56.533334 662 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]). Expected version 1 got 0
I20260620 02:55:56.534713 1566 raft_consensus.cc:482] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.534865 1566 raft_consensus.cc:504] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.535492 1566 leader_election.cc:288] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.536597 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 60301752658446f8a9d7102897bb1fd3 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.537096 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60301752658446f8a9d7102897bb1fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.537827 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ab1a97c7336431aa30d92695629aa88" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:56.538087 995 raft_consensus.cc:2454] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:56.538501 1204 leader_election.cc:302] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.538542 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ab1a97c7336431aa30d92695629aa88" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.538790 1566 raft_consensus.cc:2781] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.538779 1131 raft_consensus.cc:2454] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:56.538892 1566 raft_consensus.cc:482] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.538967 1566 raft_consensus.cc:3037] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.541796 1566 raft_consensus.cc:504] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.543316 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ab1a97c7336431aa30d92695629aa88" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:56.543725 995 raft_consensus.cc:3037] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.546164 662 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]). Expected version 1 got 0
I20260620 02:55:56.547297 995 raft_consensus.cc:2454] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:56.547919 1204 leader_election.cc:302] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.548214 1447 raft_consensus.cc:2781] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.548233 662 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]). Expected version 1 got 0
I20260620 02:55:56.548326 1447 raft_consensus.cc:686] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:56.548568 1447 consensus_queue.cc:237] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:56.548909 662 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_dc643ed381634c72bbee223a230c6049" } new_table_name: "default.Table_c87847f0b19240b3b5c151662f32d4a9" modify_external_catalogs: true
I20260620 02:55:56.550166 1566 leader_election.cc:288] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.550721 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ab1a97c7336431aa30d92695629aa88" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.550959 1131 raft_consensus.cc:3037] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.554019 1131 raft_consensus.cc:2454] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:56.557693 1625 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.558159 656 catalog_manager.cc:2148] created HMS catalog entry for table [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:55:56.560292 1625 tablet_bootstrap.cc:654] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.560709 1630 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.562700 1630 tablet_bootstrap.cc:654] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.564075 1627 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.565685 1627 tablet_bootstrap.cc:654] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.566057 656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_639b095f095048e8891596cc4922f715" } new_table_name: "default.Table_14dde7287c0b47318c45e526f722d42f" modify_external_catalogs: true
I20260620 02:55:56.582841 975 tablet_service.cc:1467] Processing CreateTablet for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (DEFAULT_TABLE table=default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.583314 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0f4099efdaf45289fe4f8bc21ad12b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.586438 1270 raft_consensus.cc:1261] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Refusing update from remote peer 880a5420b43045f4bfcf690b20dac3de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.587636 1610 consensus_queue.cc:1035] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.589552 995 raft_consensus.cc:1261] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Refusing update from remote peer 880a5420b43045f4bfcf690b20dac3de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.589610 1248 tablet_service.cc:1467] Processing CreateTablet for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (DEFAULT_TABLE table=default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.590020 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0f4099efdaf45289fe4f8bc21ad12b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.590384 1610 consensus_queue.cc:1035] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.593315 1108 tablet_service.cc:1467] Processing CreateTablet for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (DEFAULT_TABLE table=default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.593756 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0f4099efdaf45289fe4f8bc21ad12b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.593952 1625 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.594144 1625 ts_tablet_manager.cc:1397] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.011s
I20260620 02:55:56.595088 1625 raft_consensus.cc:348] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.595364 1625 raft_consensus.cc:374] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.595454 1625 raft_consensus.cc:729] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.595816 1625 consensus_queue.cc:260] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.601033 1625 ts_tablet_manager.cc:1428] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260620 02:55:56.605084 1271 raft_consensus.cc:1261] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Refusing update from remote peer 200c6cbcf0124308a686502d3ffd51bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.605754 1641 consensus_queue.cc:1035] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.608211 1131 raft_consensus.cc:1261] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Refusing update from remote peer 200c6cbcf0124308a686502d3ffd51bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.608788 1641 consensus_queue.cc:1035] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.624156 1665 tablet.cc:1722] T 0b621af903534b51b89d0bc0e5f555f8 P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.624922 1664 tablet.cc:1722] T 0b621af903534b51b89d0bc0e5f555f8 P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.625629 1627 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.625838 1627 ts_tablet_manager.cc:1397] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.002s
I20260620 02:55:56.626880 1627 raft_consensus.cc:348] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.627197 1627 raft_consensus.cc:374] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.627292 1627 raft_consensus.cc:729] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.627641 1627 consensus_queue.cc:260] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.628175 1627 ts_tablet_manager.cc:1428] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:55:56.641018 1630 tablet_bootstrap.cc:492] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.641206 1630 ts_tablet_manager.cc:1397] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.081s user 0.006s sys 0.002s
I20260620 02:55:56.642170 1630 raft_consensus.cc:348] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.642510 1630 raft_consensus.cc:374] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.642607 1630 raft_consensus.cc:729] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.643221 1630 consensus_queue.cc:260] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.644042 1630 ts_tablet_manager.cc:1428] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:55:56.644475 1630 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.648066 1625 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.648958 1630 tablet_bootstrap.cc:654] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.651968 1625 tablet_bootstrap.cc:654] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.653921 1657 mvcc.cc:205] Tried to move back new op lower bound from 7298761345365831680 to 7298761344200232960. Current Snapshot: MvccSnapshot[applied={T|T < 7298761345365831680}]
I20260620 02:55:56.653772 1666 tablet.cc:1722] T 0b621af903534b51b89d0bc0e5f555f8 P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.656237 1627 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.658538 1670 tablet.cc:1722] T ddb0e69b345a4b728949a6ff9cc3bd6f P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.660475 1627 tablet_bootstrap.cc:654] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.672410 1630 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.672574 1630 ts_tablet_manager.cc:1397] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260620 02:55:56.673373 1630 raft_consensus.cc:348] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.673593 1630 raft_consensus.cc:374] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.673676 1630 raft_consensus.cc:729] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.673882 1630 consensus_queue.cc:260] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.674440 1630 ts_tablet_manager.cc:1428] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 02:55:56.675376 1627 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.675559 1627 ts_tablet_manager.cc:1397] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260620 02:55:56.676425 1627 raft_consensus.cc:348] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.676654 1627 raft_consensus.cc:374] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.676739 1627 raft_consensus.cc:729] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.677871 1627 consensus_queue.cc:260] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.678642 1627 ts_tablet_manager.cc:1428] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 02:55:56.680974 1625 tablet_bootstrap.cc:492] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.681188 1625 ts_tablet_manager.cc:1397] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.013s
I20260620 02:55:56.682323 1625 raft_consensus.cc:348] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.682716 1625 raft_consensus.cc:374] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.682958 1625 raft_consensus.cc:729] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.683305 1625 consensus_queue.cc:260] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.684062 1625 ts_tablet_manager.cc:1428] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 02:55:56.684978 1665 tablet.cc:1722] T ddb0e69b345a4b728949a6ff9cc3bd6f P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.694957 1664 tablet.cc:1722] T ddb0e69b345a4b728949a6ff9cc3bd6f P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.700340 1447 raft_consensus.cc:482] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.700529 1447 raft_consensus.cc:504] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.701113 1447 leader_election.cc:288] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.702189 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0f4099efdaf45289fe4f8bc21ad12b3" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.702508 1131 raft_consensus.cc:2454] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:56.702970 1207 leader_election.cc:302] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.703341 1447 raft_consensus.cc:2781] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.703451 1447 raft_consensus.cc:482] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.703580 1447 raft_consensus.cc:3037] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.707103 1447 raft_consensus.cc:504] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.708425 993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0f4099efdaf45289fe4f8bc21ad12b3" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:56.708683 993 raft_consensus.cc:3037] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.712020 993 raft_consensus.cc:2454] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:56.712515 1204 leader_election.cc:302] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:56.712842 1566 raft_consensus.cc:2781] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.713014 1566 raft_consensus.cc:686] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:56.713296 1566 consensus_queue.cc:237] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.713706 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0f4099efdaf45289fe4f8bc21ad12b3" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.713943 1131 raft_consensus.cc:3037] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.716967 1131 raft_consensus.cc:2454] T e0f4099efdaf45289fe4f8bc21ad12b3 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:56.717675 1447 leader_election.cc:288] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:56.718233 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0f4099efdaf45289fe4f8bc21ad12b3" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:56.718571 995 raft_consensus.cc:2362] T e0f4099efdaf45289fe4f8bc21ad12b3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1. Re-sending same reply.
I20260620 02:55:56.742579 659 catalog_manager.cc:2148] created HMS catalog entry for table [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:55:56.752314 659 catalog_manager.cc:5495] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260620 02:55:56.758317 659 catalog_manager.cc:5587] TS 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643) does not have the latest schema for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]). Expected version 1 got 0
I20260620 02:55:56.775539 659 catalog_manager.cc:5587] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979) does not have the latest schema for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]). Expected version 1 got 0
I20260620 02:55:56.775532 975 tablet_service.cc:1467] Processing CreateTablet for tablet 9986f946441b4544b6acc01f7990468e (DEFAULT_TABLE table=default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.775875 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 9986f946441b4544b6acc01f7990468e (DEFAULT_TABLE table=default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.776032 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9986f946441b4544b6acc01f7990468e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.776281 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9986f946441b4544b6acc01f7990468e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.780052 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 9986f946441b4544b6acc01f7990468e (DEFAULT_TABLE table=default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.780458 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9986f946441b4544b6acc01f7990468e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.782835 1627 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.785034 1627 tablet_bootstrap.cc:654] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.789748 1625 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.791239 1625 tablet_bootstrap.cc:654] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.791858 659 catalog_manager.cc:5495] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f967984189c40c8afe26a19f52b782e (127.0.97.3). New cstate: current_term: 1 leader_uuid: "6f967984189c40c8afe26a19f52b782e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260620 02:55:56.793982 1630 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.795970 1630 tablet_bootstrap.cc:654] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.803259 658 catalog_manager.cc:2148] created HMS catalog entry for table [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:55:56.805750 659 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:55:56.806053 659 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:55:56.809094 658 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38692 (request call id 9) took 1052 ms. Trace:
I20260620 02:55:56.809260 658 rpcz_store.cc:276] 0620 02:55:55.756331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 02:55:55.761289 (+ 4958us) service_pool.cc:227] Handling call
0620 02:55:55.765212 (+ 3923us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x615000033024. stack: 00007f387eccc66e 00007f387eccc430 00007f387dd535ed 00000000008ea064 00000000008ea02d 00007f388d3e527d 00007f388d3e5373 00007f388a207361 00007f3891b7a66a 00007f3891d02313 00007f3888ff4466 00007f3888ff4195 00007f38858089be 00007f388580779e 00007f388580db25 00007f388580e54f
0620 02:55:55.968247 (+203035us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 02:55:55.968734 (+ 487us) catalog_manager.cc:2121] Created new table and tablet info
0620 02:55:56.803196 (+834462us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 02:55:56.808858 (+ 5662us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 02:55:56.808958 (+ 100us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 02:55:56.809054 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 02:55:56.804091 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 02:55:56.804228 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0620 02:55:56.804235 (+ 7us) write_op.cc:435] Acquired schema lock
0620 02:55:56.804240 (+ 5us) tablet.cc:660] Decoding operations
0620 02:55:56.804350 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0620 02:55:56.804366 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0620 02:55:56.804374 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0620 02:55:56.804476 (+ 102us) tablet.cc:699] Row locks acquired
0620 02:55:56.804481 (+ 5us) write_op.cc:260] PREPARE: finished
0620 02:55:56.804516 (+ 35us) write_op.cc:270] Start()
0620 02:55:56.804551 (+ 35us) write_op.cc:276] Timestamp: P: 1781924156804453 usec, L: 0
0620 02:55:56.804556 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 02:55:56.804756 (+ 200us) log.cc:842] Serialized 432 byte log entry
0620 02:55:56.807554 (+ 2798us) op_driver.cc:444] REPLICATION: finished
0620 02:55:56.807658 (+ 104us) write_op.cc:301] APPLY: starting
0620 02:55:56.807671 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0620 02:55:56.807706 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0620 02:55:56.807734 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 02:55:56.807847 (+ 113us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 02:55:56.807877 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 02:55:56.807883 (+ 6us) write_op.cc:312] APPLY: finished
0620 02:55:56.807951 (+ 68us) log.cc:842] Serialized 28 byte log entry
0620 02:55:56.808005 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:56.808021 (+ 16us) write_op.cc:454] Released schema lock
0620 02:55:56.808027 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 02:55:56.808076 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0620 02:55:56.808079 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":773444,"Hive Metastore.run_cpu_time_us":261,"Hive Metastore.run_wall_time_us":60755,"spinlock_wait_cycles":8260992,"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":466,"apply.run_wall_time_us":466,"num_ops":2,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":822,"prepare.run_wall_time_us":822,"raft.queue_time_us":324,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":788,"replication_time_us":2977,"spinlock_wait_cycles":23424}]]}
I20260620 02:55:56.811499 1627 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.811625 658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
I20260620 02:55:56.811720 1627 ts_tablet_manager.cc:1397] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.001s
I20260620 02:55:56.811829 658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
I20260620 02:55:56.812534 1627 raft_consensus.cc:348] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.812808 1627 raft_consensus.cc:374] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.812904 1627 raft_consensus.cc:729] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.813169 1627 consensus_queue.cc:260] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.813808 1627 ts_tablet_manager.cc:1428] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 02:55:56.821035 876 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:55:56.821318 876 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:55:56.821393 876 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
*** Check failure stack trace: ***
@ 0x7f387c0c69ad google::LogMessage::Fail() at ??:0
@ 0x7f387c0c988a google::LogMessage::SendToLog() at ??:0
@ 0x7f387c0c64de google::LogMessage::Flush() at ??:0
@ 0x7f387c0c66d1 google::LogMessage::~LogMessage() at ??:0
I20260620 02:55:56.837459 975 tablet_service.cc:1467] Processing CreateTablet for tablet ae99f00924a84045b5f18f23a96421e9 (DEFAULT_TABLE table=default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.837929 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae99f00924a84045b5f18f23a96421e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.838426 1248 tablet_service.cc:1467] Processing CreateTablet for tablet ae99f00924a84045b5f18f23a96421e9 (DEFAULT_TABLE table=default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.838420 1108 tablet_service.cc:1467] Processing CreateTablet for tablet ae99f00924a84045b5f18f23a96421e9 (DEFAULT_TABLE table=default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:56.838798 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae99f00924a84045b5f18f23a96421e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.838825 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae99f00924a84045b5f18f23a96421e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:56.845177 1627 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:56.846915 1627 tablet_bootstrap.cc:654] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
@ 0x7f3891c64ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f3891c63901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:55:56.861385 1625 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.861573 1625 ts_tablet_manager.cc:1397] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.072s user 0.009s sys 0.002s
I20260620 02:55:56.862406 1627 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:56.862548 1627 ts_tablet_manager.cc:1397] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.006s
I20260620 02:55:56.862530 1625 raft_consensus.cc:348] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.862799 1625 raft_consensus.cc:374] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.862875 1625 raft_consensus.cc:729] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.863157 1625 consensus_queue.cc:260] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.863288 1627 raft_consensus.cc:348] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.863528 1627 raft_consensus.cc:374] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.863613 1627 raft_consensus.cc:729] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.863883 1627 consensus_queue.cc:260] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.864593 1625 ts_tablet_manager.cc:1428] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:55:56.864866 1625 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:56.866326 1627 ts_tablet_manager.cc:1428] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260620 02:55:56.866500 1625 tablet_bootstrap.cc:654] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.867115 1630 tablet_bootstrap.cc:492] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.867355 1630 ts_tablet_manager.cc:1397] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.073s user 0.018s sys 0.016s
I20260620 02:55:56.870601 1630 raft_consensus.cc:348] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.870850 1630 raft_consensus.cc:374] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.870929 1630 raft_consensus.cc:729] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.871212 1630 consensus_queue.cc:260] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.876611 1625 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:56.876744 1625 ts_tablet_manager.cc:1397] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260620 02:55:56.876925 1630 ts_tablet_manager.cc:1428] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260620 02:55:56.877480 1625 raft_consensus.cc:348] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.877678 1625 raft_consensus.cc:374] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.878183 1625 raft_consensus.cc:729] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.878434 1625 consensus_queue.cc:260] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
@ 0x7f3891c6a66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 02:55:56.882447 1625 ts_tablet_manager.cc:1428] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 02:55:56.882606 994 raft_consensus.cc:1261] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Refusing update from remote peer 6f967984189c40c8afe26a19f52b782e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.883031 1131 raft_consensus.cc:1261] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Refusing update from remote peer 6f967984189c40c8afe26a19f52b782e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 02:55:56.884122 1447 consensus_queue.cc:1035] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7f3891c6a4e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 02:55:56.886786 1566 consensus_queue.cc:1035] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f387ecf0eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:55:56.892876 1665 tablet.cc:1722] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
@ 0x7f3881fca6db start_thread at ??:0
@ 0x7f387af6061f clone at ??:0
I20260620 02:55:56.898200 1664 tablet.cc:1722] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.903968 1630 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:56.908000 1630 tablet_bootstrap.cc:654] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:56.910866 1670 tablet.cc:1722] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 02:55:56.917445 1641 consensus_queue.cc:1035] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.920588 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu pid 633
I20260620 02:55:56.924952 1630 tablet_bootstrap.cc:492] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:56.925160 1630 ts_tablet_manager.cc:1397] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20260620 02:55:56.926103 1630 raft_consensus.cc:348] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.926321 1630 raft_consensus.cc:374] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:56.926414 1630 raft_consensus.cc:729] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:56.926635 1630 consensus_queue.cc:260] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.928188 1630 ts_tablet_manager.cc:1428] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 02:55:56.932421 1637 consensus_queue.cc:1035] T 60d4ef253c6f4e5397187e78231b5503 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:56.937342 1637 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:56.937492 1637 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.938098 1637 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:56.940379 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9986f946441b4544b6acc01f7990468e" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:56.940426 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9986f946441b4544b6acc01f7990468e" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:56.940608 1130 raft_consensus.cc:2454] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.940661 1270 raft_consensus.cc:2454] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:56.941061 931 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.941361 1637 raft_consensus.cc:2781] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:56.941478 1637 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:56.941560 1637 raft_consensus.cc:3037] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.944315 1637 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:56.945362 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9986f946441b4544b6acc01f7990468e" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:56.945565 1130 raft_consensus.cc:3037] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.947386 1637 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:56.947892 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9986f946441b4544b6acc01f7990468e" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:56.948122 1270 raft_consensus.cc:3037] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:56.951027 1130 raft_consensus.cc:2454] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.951479 931 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:56.951632 1270 raft_consensus.cc:2454] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:56.951994 1637 raft_consensus.cc:2781] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:56.952468 1637 raft_consensus.cc:686] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:56.952762 1637 consensus_queue.cc:237] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.034168 1447 raft_consensus.cc:482] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:57.034373 1447 raft_consensus.cc:504] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.035158 1447 leader_election.cc:288] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:57.035723 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae99f00924a84045b5f18f23a96421e9" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:57.035748 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae99f00924a84045b5f18f23a96421e9" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:57.035976 1130 raft_consensus.cc:2454] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:57.036010 994 raft_consensus.cc:2454] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
I20260620 02:55:57.036408 1204 leader_election.cc:302] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:57.036645 1447 raft_consensus.cc:2781] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:57.036746 1447 raft_consensus.cc:482] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:57.036818 1447 raft_consensus.cc:3037] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.038688 1447 raft_consensus.cc:504] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.039561 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae99f00924a84045b5f18f23a96421e9" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:57.039542 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae99f00924a84045b5f18f23a96421e9" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:57.039726 1130 raft_consensus.cc:3037] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.039744 994 raft_consensus.cc:3037] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.041330 1447 leader_election.cc:288] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:57.042399 994 raft_consensus.cc:2454] T ae99f00924a84045b5f18f23a96421e9 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:57.042413 1130 raft_consensus.cc:2454] T ae99f00924a84045b5f18f23a96421e9 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:57.042887 1204 leader_election.cc:302] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:57.043586 1447 raft_consensus.cc:2781] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:57.043741 1447 raft_consensus.cc:686] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:57.044035 1447 consensus_queue.cc:237] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.113541 1637 raft_consensus.cc:482] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:57.113776 1637 raft_consensus.cc:504] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.114408 1637 leader_election.cc:288] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:57.115062 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60301752658446f8a9d7102897bb1fd3" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:55:57.115077 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60301752658446f8a9d7102897bb1fd3" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:57.115326 1270 raft_consensus.cc:2454] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:57.115459 1130 raft_consensus.cc:2454] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:55:57.115922 931 leader_election.cc:302] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:57.116187 1637 raft_consensus.cc:2781] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:57.116279 1637 raft_consensus.cc:482] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:57.116389 1637 raft_consensus.cc:3037] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.118175 1637 raft_consensus.cc:504] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.118652 1637 leader_election.cc:288] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:57.119285 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60301752658446f8a9d7102897bb1fd3" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:57.119472 1270 raft_consensus.cc:3037] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.121338 1270 raft_consensus.cc:2454] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:57.121351 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60301752658446f8a9d7102897bb1fd3" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:55:57.121784 931 leader_election.cc:302] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:55:57.121821 1130 raft_consensus.cc:3037] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.122051 1637 raft_consensus.cc:2781] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:57.122808 1637 raft_consensus.cc:686] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:57.123095 1637 consensus_queue.cc:237] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.125118 1130 raft_consensus.cc:2454] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
W20260620 02:55:57.145684 1206 connection.cc:535] server connection from 127.0.0.1:43328 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.145989 1328 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.146881 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:46739)
W20260620 02:55:57.147883 1328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:46739)
W20260620 02:55:57.148284 1328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:46739)
W20260620 02:55:57.149288 393 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.149552 1702 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:55:57.147303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.62:46739 (local address 127.0.97.2:34625)
0620 02:55:57.148380 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0620 02:55:57.148516 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":752,"threads_started":1}
W20260620 02:55:57.149613 388 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu pid 633: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 02:55:57.149822 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu with pid 633
W20260620 02:55:57.149273 1328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:46739)
W20260620 02:55:57.150080 1701 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:55:57.146916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.62:46739 (local address 127.0.97.3:38635)
0620 02:55:57.148940 (+ 2024us) negotiation.cc:107] Waiting for socket to connect
0620 02:55:57.149078 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1894,"thread_start_us":1779,"threads_started":1}
I20260620 02:55:57.194031 1637 consensus_queue.cc:1035] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.200201 1637 consensus_queue.cc:1035] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.340580 1707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:55:57.340803 1707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:57.342483 1707 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
I20260620 02:55:57.343484 743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 3 candidate_status { last_received { term: 2 index: 72 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
W20260620 02:55:57.343503 1487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:55:57.344983 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:55:57.345148 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:55:57.345669 1707 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 02:55:57.346905 1710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:55:57.347049 1710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:57.347605 1710 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:57.348058 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 72 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:57.348263 1516 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 2.
W20260620 02:55:57.348364 720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260620 02:55:57.348727 721 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435; no voters:
I20260620 02:55:57.349021 1710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 02:55:57.349118 1710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:55:57.349270 1710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260620 02:55:57.351307 1710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:57.351835 1710 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 election: Requested vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:55:57.352320 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 72 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435"
I20260620 02:55:57.352496 1516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 2 FOLLOWER]: Advancing to term 3
I20260620 02:55:57.354362 1516 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 3.
I20260620 02:55:57.354737 721 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435; no voters:
I20260620 02:55:57.355019 1710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Leader election won for term 3
W20260620 02:55:57.355355 720 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:55:57.355482 1710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 LEADER]: Becoming Leader. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Running, Role: LEADER
I20260620 02:55:57.355762 1710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 2.72, Last appended by leader: 72, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
W20260620 02:55:57.356583 720 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:55:57.356978 1713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 3 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:57.357378 1713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:57.357956 1714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:55:57.360628 1714 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:55:57.361822 1714 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:55:57.362236 1714 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:55:57.362643 1714 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:55:57.362941 1714 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:55:57.363262 1714 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:55:57.363605 1714 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:55:57.363960 1714 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:55:57.364313 1714 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:55:57.364656 1714 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:55:57.365018 1714 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:55:57.365370 1714 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:55:57.365753 1714 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:55:57.366125 1714 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:55:57.368204 1714 tablet_loader.cc:96] loaded metadata for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:55:57.368749 1714 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:55:57.369082 1714 tablet_loader.cc:96] loaded metadata for tablet 4b05d8ae218e4455902714f556589aea (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:55:57.369438 1714 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:55:57.369766 1714 tablet_loader.cc:96] loaded metadata for tablet 60d4ef253c6f4e5397187e78231b5503 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:55:57.370101 1714 tablet_loader.cc:96] loaded metadata for tablet 6acad10256014c42a04a87c7fbb0d68a (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:55:57.370414 1714 tablet_loader.cc:96] loaded metadata for tablet 6b564408f536421b9e3c29099badd07d (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:55:57.370893 1714 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:55:57.371624 1714 tablet_loader.cc:96] loaded metadata for tablet 895f9db9d57140fda82e39b4fe631aaf (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:55:57.371961 1714 tablet_loader.cc:96] loaded metadata for tablet 9986f946441b4544b6acc01f7990468e (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:55:57.372257 1714 tablet_loader.cc:96] loaded metadata for tablet ae99f00924a84045b5f18f23a96421e9 (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:55:57.372946 1714 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:55:57.373293 1714 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:55:57.373838 1714 tablet_loader.cc:96] loaded metadata for tablet f954b0eb11a54057b3efec093f28dba7 (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:55:57.374358 1714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:55:57.375955 1714 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:57.376042 1714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:55:57.378217 1714 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:55:57.379699 1714 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Loaded TSK: 0
I20260620 02:55:57.380426 1714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:55:57.381860 1714 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:55:57.383360 1714 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:55:57.397864 733 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_0c298c487d434f67b0a47a53292c42a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.397938 725 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_c8a7ae199f32436d8fd09b4aad018b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.398202 734 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_5fe1f2b14780430cb07cfd13f5ea91c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.398397 729 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_50de7b3586d54bcd96eaa04479c238c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.398453 731 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_1550ec9bf27b4226877f1c598bc58599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.398584 727 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_bedc0a11a14744d3a493a3239abf429b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.398859 726 master_service.cc:946] ReplaceTablet: received request to replace tablet f954b0eb11a54057b3efec093f28dba7 from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:57.398761 730 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_0c6fd9cb1b4c46f1bf1d51a97c26196a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.400243 728 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56978:
name: "default.Table_4de3fc606f0549218237315827ac3a45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:57.401139 732 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56978:
table { table_name: "default.Table_93f177252a6c4a49b1c2cd213cc0e1ba" } new_table_name: "default.Table_be09d676a02748338b4b22de5b701eb0" modify_external_catalogs: true
I20260620 02:55:57.408102 1516 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Refusing update from remote peer 38d9721548804411b8e68a41e247d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 72. Preceding OpId from leader: term: 3 index: 74. (index mismatch)
I20260620 02:55:57.408773 1713 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260620 02:55:57.409157 896 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:55:57.409566 896 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:55:57.409667 896 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
*** Check failure stack trace: ***
W20260620 02:55:57.410349 720 consensus_peers.cc:487] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 -> Peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Couldn't send request to peer 7e68099b11fb4e71a63f9749ec9da6bf. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7fb9962a29ad google::LogMessage::Fail() at ??:0
@ 0x7fb9962a588a google::LogMessage::SendToLog() at ??:0
@ 0x7fb9962a24de google::LogMessage::Flush() at ??:0
@ 0x7fb9962a26d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fb9abe40ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fb9abe3f901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:55:57.430501 1707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 3 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:57.430763 1707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fb9abe4666c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fb9abe464e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb998ecceaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:55:57.446532 1713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:57.446893 1713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
@ 0x7fb99c1a66db start_thread at ??:0
I20260620 02:55:57.447646 726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet f954b0eb11a54057b3efec093f28dba7
I20260620 02:55:57.448235 726 catalog_manager.cc:6565] ReplaceTablet: tablet f954b0eb11a54057b3efec093f28dba7 deleted and replaced by tablet ac066f4fd56c4e439d0bf1ff09067717
I20260620 02:55:57.448558 975 tablet_service.cc:1514] Processing DeleteTablet for tablet f954b0eb11a54057b3efec093f28dba7 with delete_type TABLET_DATA_DELETED (replaced by tablet ac066f4fd56c4e439d0bf1ff09067717) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:57.448601 726 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b564408f536421b9e3c29099badd07d from {username='slave'} at 127.0.0.1:56978
I20260620 02:55:57.450672 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet f954b0eb11a54057b3efec093f28dba7 with delete_type TABLET_DATA_DELETED (replaced by tablet ac066f4fd56c4e439d0bf1ff09067717) from {username='slave'} at 127.0.0.1:43326
I20260620 02:55:57.452128 1727 tablet_replica.cc:330] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:57.452415 1727 raft_consensus.cc:2229] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:57.452819 1727 raft_consensus.cc:2258] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.453680 1727 ts_tablet_manager.cc:1905] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:57.453995 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet f954b0eb11a54057b3efec093f28dba7 with delete_type TABLET_DATA_DELETED (replaced by tablet ac066f4fd56c4e439d0bf1ff09067717) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:57.455163 1707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:57.455369 1707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:57.459802 726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 6b564408f536421b9e3c29099badd07d
I20260620 02:55:57.460364 726 catalog_manager.cc:6565] ReplaceTablet: tablet 6b564408f536421b9e3c29099badd07d deleted and replaced by tablet 0de4191c5bd74289b7ea8528f02a794c
I20260620 02:55:57.460618 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b564408f536421b9e3c29099badd07d with delete_type TABLET_DATA_DELETED (replaced by tablet 0de4191c5bd74289b7ea8528f02a794c) from {username='slave'} at 127.0.0.1:32798
I20260620 02:55:57.461719 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b564408f536421b9e3c29099badd07d with delete_type TABLET_DATA_DELETED (replaced by tablet 0de4191c5bd74289b7ea8528f02a794c) from {username='slave'} at 127.0.0.1:43326
I20260620 02:55:57.462159 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b564408f536421b9e3c29099badd07d with delete_type TABLET_DATA_DELETED (replaced by tablet 0de4191c5bd74289b7ea8528f02a794c) from {username='slave'} at 127.0.0.1:40662
I20260620 02:55:57.463977 971 tablet_service.cc:1467] Processing CreateTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:57.464363 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac066f4fd56c4e439d0bf1ff09067717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:57.464795 1727 ts_tablet_manager.cc:1918] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:57.464699 1248 tablet_service.cc:1467] Processing CreateTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:57.465116 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac066f4fd56c4e439d0bf1ff09067717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:57.465591 1110 tablet_service.cc:1467] Processing CreateTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:57.465953 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac066f4fd56c4e439d0bf1ff09067717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:57.472064 1727 log.cc:1196] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/f954b0eb11a54057b3efec093f28dba7
I20260620 02:55:57.472651 1727 ts_tablet_manager.cc:1939] T f954b0eb11a54057b3efec093f28dba7 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:57.473692 1727 tablet_replica.cc:330] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:57.473892 1727 raft_consensus.cc:2229] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:57.474080 1727 raft_consensus.cc:2258] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.474613 1727 ts_tablet_manager.cc:1905] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fb99513c61f clone at ??:0
I20260620 02:55:57.481933 1447 consensus_queue.cc:1035] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.489913 1727 ts_tablet_manager.cc:1918] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:57.490053 1727 log.cc:1196] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/6b564408f536421b9e3c29099badd07d
I20260620 02:55:57.490453 1727 ts_tablet_manager.cc:1939] T 6b564408f536421b9e3c29099badd07d P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:57.493976 1732 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:57.496701 1729 tablet_replica.cc:330] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:57.496925 1729 raft_consensus.cc:2229] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:57.496987 1735 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:57.497139 1729 raft_consensus.cc:2258] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.497494 1566 consensus_queue.cc:1035] T e0f4099efdaf45289fe4f8bc21ad12b3 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.497737 1729 ts_tablet_manager.cc:1905] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:57.498787 1735 tablet_bootstrap.cc:654] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:57.499501 1726 tablet_replica.cc:330] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:57.499730 1726 raft_consensus.cc:2229] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:57.499960 1726 raft_consensus.cc:2258] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.500690 1734 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:55:57.501178 1732 tablet_bootstrap.cc:654] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:57.501605 1726 ts_tablet_manager.cc:1905] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260620 02:55:57.512043 1068 consensus_peers.cc:487] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de -> Peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Couldn't send request to peer 6f967984189c40c8afe26a19f52b782e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b564408f536421b9e3c29099badd07d. This is attempt 1: this message will repeat every 5th retry.
I20260620 02:55:57.520633 1732 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:57.520761 1732 ts_tablet_manager.cc:1397] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260620 02:55:57.521476 1732 raft_consensus.cc:348] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.521692 1732 raft_consensus.cc:374] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:57.521763 1732 raft_consensus.cc:729] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:57.522148 1732 consensus_queue.cc:260] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.524163 1732 ts_tablet_manager.cc:1428] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:55:57.525068 1734 tablet_bootstrap.cc:654] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:57.530085 1729 ts_tablet_manager.cc:1918] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:57.531239 1729 log.cc:1196] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/f954b0eb11a54057b3efec093f28dba7
I20260620 02:55:57.532021 1735 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:57.532166 1735 ts_tablet_manager.cc:1397] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.010s
I20260620 02:55:57.533043 1726 ts_tablet_manager.cc:1918] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:57.532930 1735 raft_consensus.cc:348] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.533147 1726 log.cc:1196] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/f954b0eb11a54057b3efec093f28dba7
I20260620 02:55:57.533154 1735 raft_consensus.cc:374] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:57.533264 1735 raft_consensus.cc:729] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:57.533619 1726 ts_tablet_manager.cc:1939] T f954b0eb11a54057b3efec093f28dba7 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:57.533548 1735 consensus_queue.cc:260] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.534538 1726 tablet_replica.cc:330] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:57.535084 1726 raft_consensus.cc:2229] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:57.535247 1726 raft_consensus.cc:2258] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.535748 1726 ts_tablet_manager.cc:1905] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:57.537302 1735 ts_tablet_manager.cc:1428] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 02:55:57.540793 1734 tablet_bootstrap.cc:492] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:55:57.540940 1734 ts_tablet_manager.cc:1397] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260620 02:55:57.541455 1726 ts_tablet_manager.cc:1918] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:57.541566 1726 log.cc:1196] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/6b564408f536421b9e3c29099badd07d
I20260620 02:55:57.541694 1734 raft_consensus.cc:348] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.541896 1726 ts_tablet_manager.cc:1939] T 6b564408f536421b9e3c29099badd07d P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:57.541965 1734 raft_consensus.cc:374] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:57.542057 1734 raft_consensus.cc:729] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:55:57.542292 1734 consensus_queue.cc:260] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.544023 1734 ts_tablet_manager.cc:1428] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:55:57.544123 1729 ts_tablet_manager.cc:1939] T f954b0eb11a54057b3efec093f28dba7 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:55:57.545699 1729 tablet_replica.cc:330] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:55:57.545887 1729 raft_consensus.cc:2229] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:57.546176 1729 raft_consensus.cc:2258] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:57.546701 1729 ts_tablet_manager.cc:1905] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:57.551363 1729 ts_tablet_manager.cc:1918] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:55:57.551465 1729 log.cc:1196] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/6b564408f536421b9e3c29099badd07d
I20260620 02:55:57.551724 1729 ts_tablet_manager.cc:1939] T 6b564408f536421b9e3c29099badd07d P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
W20260620 02:55:57.698784 1067 connection.cc:535] server connection from 127.0.0.1:40662 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.698814 1328 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.699054 1067 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.699193 1207 connection.cc:535] server connection from 127.0.0.1:43326 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.699368 929 connection.cc:535] server connection from 127.0.0.1:32798 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.699644 930 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:57.700767 1206 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 02:55:57.798221 1641 consensus_queue.cc:1035] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.804623 1746 consensus_queue.cc:1035] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.808175 1566 consensus_queue.cc:1035] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.818482 1566 consensus_queue.cc:1035] T ae99f00924a84045b5f18f23a96421e9 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:57.835877 1672 raft_consensus.cc:482] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:57.836040 1672 raft_consensus.cc:504] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.836572 1672 leader_election.cc:288] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:57.837029 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac066f4fd56c4e439d0bf1ff09067717" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:57.837026 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac066f4fd56c4e439d0bf1ff09067717" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:57.837283 994 raft_consensus.cc:2454] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:57.837307 1270 raft_consensus.cc:2454] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:55:57.837675 1068 leader_election.cc:302] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:57.837966 1672 raft_consensus.cc:2781] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:57.838084 1672 raft_consensus.cc:482] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:57.838197 1672 raft_consensus.cc:3037] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.840099 1672 raft_consensus.cc:504] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.840615 1672 leader_election.cc:288] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:57.841032 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac066f4fd56c4e439d0bf1ff09067717" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:57.841063 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac066f4fd56c4e439d0bf1ff09067717" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:57.841188 994 raft_consensus.cc:3037] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.841344 1270 raft_consensus.cc:3037] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:57.843261 994 raft_consensus.cc:2454] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:57.843608 1065 leader_election.cc:302] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:55:57.843771 1270 raft_consensus.cc:2454] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:55:57.843945 1672 raft_consensus.cc:2781] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:57.844499 1672 raft_consensus.cc:686] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Becoming Leader. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Running, Role: LEADER
I20260620 02:55:57.844771 1672 consensus_queue.cc:237] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:57.965641 1756 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:57.965806 1756 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:57.966416 1756 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:55:57.969322 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:55:57.969728 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:57.969866 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:55:57.970167 1756 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 02:55:58.089866 1746 consensus_queue.cc:1035] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:58.095781 1641 consensus_queue.cc:1035] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:58.121642 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--webserver_interface=127.0.97.62
--webserver_port=38827
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 02:55:58.471666 1762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:55:58.471939 1762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:55:58.472064 1762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:55:58.480484 1762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:55:58.480581 1762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:55:58.480659 1762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:55:58.480759 1762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:55:58.490666 1762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=38827
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:55:58.491978 1762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:55:58.493736 1762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:55:58.506140 1769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:58.506168 1770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:55:58.506192 1772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:55:58.506880 1762 server_base.cc:1034] running on GCE node
I20260620 02:55:58.507709 1762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:55:58.509186 1762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:55:58.510457 1762 hybrid_clock.cc:648] HybridClock initialized: now 1781924158510396 us; error 69 us; skew 500 ppm
I20260620 02:55:58.510813 1762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:55:58.513708 1776 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:58.513826 1762 webserver.cc:460] Webserver started at http://127.0.97.62:38827/ using document root <none> and password file <none>
I20260620 02:55:58.513958 1776 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:58.514623 1762 fs_manager.cc:359] Metadata directory not provided
I20260620 02:55:58.514786 1762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:55:58.516359 1776 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:55:58.518828 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:55:58.519090 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:58.519232 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:55:58.519485 1776 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 02:55:58.521466 1762 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260620 02:55:58.524937 1782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:55:58.526399 1762 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260620 02:55:58.526595 1762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:55:58.527508 1762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:55:58.539242 1762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:55:58.540063 1762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:55:58.540336 1762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:55:58.560884 1762 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:46739
I20260620 02:55:58.560895 1833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:46739 every 8 connection(s)
I20260620 02:55:58.562424 1762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
I20260620 02:55:58.569113 1834 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:55:58.570709 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 1762
I20260620 02:55:58.573218 1834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap starting.
I20260620 02:55:58.589607 1834 log.cc:824] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Log is configured to *not* fsync() on all Append() calls
I20260620 02:55:58.609265 1178 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:58.622923 1041 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:58.652210 1834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=72 overwritten=0 applied=72 ignored=0} inserts{seen=50 ignored=0} mutations{seen=56 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:55:58.652776 1834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap complete.
I20260620 02:55:58.660463 1834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:58.661358 1834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Initialized, Role: FOLLOWER
I20260620 02:55:58.661892 1834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 72, Last appended: 2.72, Last appended by leader: 72, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:58.662648 1842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:58.663089 1842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:58.663700 1834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:55:58.676383 1856 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:58.676524 1856 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: loading cluster ID for follower catalog manager: success
I20260620 02:55:58.681008 1856 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: acquiring CA information for follower catalog manager: success
I20260620 02:55:58.684263 1856 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:55:58.695083 1762 master_runner.cc:186] Error getting master registration for 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111),
I20260620 02:55:58.704560 1762 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:55:58.738131 1672 consensus_queue.cc:1035] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:58.749115 1317 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:55:58.753515 1799 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:49845; Asking this server to re-register.
I20260620 02:55:58.754526 1317 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:58.756422 1672 consensus_queue.cc:1035] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:55:58.756620 1799 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:55:58.759948 1799 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:46713; Asking this server to re-register.
I20260620 02:55:58.761461 1178 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:58.763581 1798 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:58.765543 1799 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:50915; Asking this server to re-register.
I20260620 02:55:58.766119 1041 heartbeater.cc:464] Registering TS with master...
I20260620 02:55:58.767814 1799 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:59.206941 1870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:59.207157 1870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:59.208740 1870 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:55:59.209697 1785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:55:59.211055 1785 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:59.215327 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 72 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:55:59.215631 1516 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e68099b11fb4e71a63f9749ec9da6bf in current term 3: Already voted for candidate 38d9721548804411b8e68a41e247d9a8 in this term.
I20260620 02:55:59.216207 1786 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:55:59.216588 1870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 2 FOLLOWER]: Advancing to term 3
I20260620 02:55:59.220434 1870 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 02:55:59.321753 1878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:59.322081 1878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:59.322671 1878 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:55:59.325994 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:59.329989 1809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 4 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:55:59.330549 1809 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f31390712542bf916d639cd0e4a435 in term 3.
I20260620 02:55:59.331104 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:55:59.331421 1878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 02:55:59.331547 1878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:55:59.331646 1878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 3 FOLLOWER]: Advancing to term 4
I20260620 02:55:59.334040 1878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:59.334481 1878 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 election: Requested vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
I20260620 02:55:59.335245 1809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 4 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
I20260620 02:55:59.335518 1809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 3 FOLLOWER]: Advancing to term 4
W20260620 02:55:59.336216 1487 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:55:59.337750 1809 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f31390712542bf916d639cd0e4a435 in term 4.
I20260620 02:55:59.338138 1487 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:55:59.338454 1878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 02:55:59.338889 1878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 LEADER]: Becoming Leader. State: Replica: 88f31390712542bf916d639cd0e4a435, State: Running, Role: LEADER
I20260620 02:55:59.339301 1878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 3.76, Last appended by leader: 76, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:55:59.340947 1883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f31390712542bf916d639cd0e4a435. Latest consensus state: current_term: 4 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:59.341534 1883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:59.342475 1885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:55:59.345464 1885 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:55:59.346238 1885 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:55:59.346625 1885 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:55:59.346974 1885 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:55:59.347289 1885 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:55:59.347625 1885 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:55:59.347939 1885 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:55:59.348258 1885 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:55:59.348574 1885 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:55:59.348891 1885 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:55:59.349196 1885 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:55:59.349566 1885 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:55:59.349881 1885 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:55:59.350193 1885 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:55:59.351917 1885 tablet_loader.cc:96] loaded metadata for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:55:59.352217 1885 tablet_loader.cc:96] loaded metadata for tablet 0de4191c5bd74289b7ea8528f02a794c (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:55:59.352640 1885 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:55:59.352928 1885 tablet_loader.cc:96] loaded metadata for tablet 4b05d8ae218e4455902714f556589aea (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:55:59.353193 1885 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:55:59.353562 1885 tablet_loader.cc:96] loaded metadata for tablet 60d4ef253c6f4e5397187e78231b5503 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:55:59.353858 1885 tablet_loader.cc:96] loaded metadata for tablet 6acad10256014c42a04a87c7fbb0d68a (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:55:59.354388 1885 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:55:59.354907 1885 tablet_loader.cc:96] loaded metadata for tablet 895f9db9d57140fda82e39b4fe631aaf (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:55:59.355185 1885 tablet_loader.cc:96] loaded metadata for tablet 9986f946441b4544b6acc01f7990468e (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:55:59.355453 1885 tablet_loader.cc:96] loaded metadata for tablet ac066f4fd56c4e439d0bf1ff09067717 (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:55:59.355736 1885 tablet_loader.cc:96] loaded metadata for tablet ae99f00924a84045b5f18f23a96421e9 (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:55:59.356254 1885 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:55:59.356564 1885 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:55:59.357082 1885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:55:59.358417 1885 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:55:59.358497 1885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:55:59.360090 1885 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:55:59.361364 1885 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Loaded TSK: 0
I20260620 02:55:59.362215 1885 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:55:59.363404 1885 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:55:59.365289 1885 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:55:59.426940 1507 master_service.cc:946] ReplaceTablet: received request to replace tablet 9986f946441b4544b6acc01f7990468e from {username='slave'} at 127.0.0.1:55848
I20260620 02:55:59.427042 1505 master_service.cc:946] ReplaceTablet: received request to replace tablet 895f9db9d57140fda82e39b4fe631aaf from {username='slave'} at 127.0.0.1:55848
I20260620 02:55:59.430169 1503 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_bc27032cc2ca40b1a29b31593c811b0c" } new_table_name: "default.Table_ab662cd82b9b4c5389924ad4ff7846b7" modify_external_catalogs: true
I20260620 02:55:59.428761 1501 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_dc643ed381634c72bbee223a230c6049" } new_table_name: "default.Table_c87847f0b19240b3b5c151662f32d4a9" modify_external_catalogs: true
I20260620 02:55:59.429109 1499 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_639b095f095048e8891596cc4922f715" } new_table_name: "default.Table_14dde7287c0b47318c45e526f722d42f" modify_external_catalogs: true
I20260620 02:55:59.428354 1500 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_4377b6cf14a84e548766cd36e6fc68e0" } new_table_name: "default.Table_59f7fde270354419ba554c2cdb50b188" modify_external_catalogs: true
I20260620 02:55:59.429544 1506 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55848:
name: "default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:55:59.427893 1502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:55:59.429886 1504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:55:59.440831 1504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:55:59.441500 1502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:55:59.429842 1498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:55:59.443557 1498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:55:59.444113 1570 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:55:59.444535 1570 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:55:59.444644 1570 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
*** Check failure stack trace: ***
W20260620 02:55:59.445225 1487 consensus_peers.cc:487] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 -> Peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Couldn't send request to peer 38d9721548804411b8e68a41e247d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 02:55:59.445537 1809 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Refusing update from remote peer 88f31390712542bf916d639cd0e4a435: Log matching property violated. Preceding OpId in replica: term: 2 index: 72. Preceding OpId from leader: term: 4 index: 78. (index mismatch)
I20260620 02:55:59.446329 1883 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 72, Time since last communication: 0.000s
@ 0x7f5a9b9079ad google::LogMessage::Fail() at ??:0
@ 0x7f5a9b90a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f5a9b9074de google::LogMessage::Flush() at ??:0
@ 0x7f5a9b9076d1 google::LogMessage::~LogMessage() at ??:0
I20260620 02:55:59.456836 1888 mvcc.cc:205] Tried to move back new op lower bound from 7298761348925120512 to 7298761348531642368. Current Snapshot: MvccSnapshot[applied={T|T < 7298761348925120512}]
@ 0x7f5ab14a5ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f5ab14a4901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:55:59.467214 1870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f31390712542bf916d639cd0e4a435. Latest consensus state: current_term: 4 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:59.467602 1870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:59.467541 1890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:59.467881 1890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:55:59.469072 1890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:59.469313 1890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f5ab14ab66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 02:55:59.475018 1505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Sending DeleteTablet for 3 replicas of tablet 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:55:59.476652 1505 catalog_manager.cc:6565] ReplaceTablet: tablet 895f9db9d57140fda82e39b4fe631aaf deleted and replaced by tablet cc7f4ba88f254a26a63205fe13331249
@ 0x7f5ab14ab4e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 02:55:59.491125 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 895f9db9d57140fda82e39b4fe631aaf with delete_type TABLET_DATA_DELETED (replaced by tablet cc7f4ba88f254a26a63205fe13331249) from {username='slave'} at 127.0.0.1:32812
I20260620 02:55:59.498293 1505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:55:59.498548 1505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:55:59.499012 1883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:55:59.499300 1883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: LEADER
I20260620 02:55:59.503283 1904 tablet_replica.cc:330] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:59.503507 1904 raft_consensus.cc:2229] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:59.503930 1904 raft_consensus.cc:2258] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:59.504599 1904 ts_tablet_manager.cc:1905] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 02:55:59.507617 1507 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Sending DeleteTablet for 3 replicas of tablet 9986f946441b4544b6acc01f7990468e
I20260620 02:55:59.508121 1507 catalog_manager.cc:6565] ReplaceTablet: tablet 9986f946441b4544b6acc01f7990468e deleted and replaced by tablet 10fd34892bed4c78801d349e4f332f9c
I20260620 02:55:59.509629 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 9986f946441b4544b6acc01f7990468e with delete_type TABLET_DATA_DELETED (replaced by tablet 10fd34892bed4c78801d349e4f332f9c) from {username='slave'} at 127.0.0.1:32812
I20260620 02:55:59.509999 1507 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
I20260620 02:55:59.510226 1507 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55848:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
@ 0x7f5a9e531eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:55:59.515720 975 tablet_service.cc:1467] Processing CreateTablet for tablet 0de4191c5bd74289b7ea8528f02a794c (DEFAULT_TABLE table=default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:59.516141 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de4191c5bd74289b7ea8528f02a794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:59.517787 1904 ts_tablet_manager.cc:1918] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:59.517918 1904 log.cc:1196] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/895f9db9d57140fda82e39b4fe631aaf
I20260620 02:55:59.518426 1904 ts_tablet_manager.cc:1939] T 895f9db9d57140fda82e39b4fe631aaf P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:59.521449 1485 catalog_manager.cc:4841] TS 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): tablet 895f9db9d57140fda82e39b4fe631aaf (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]) successfully deleted
@ 0x7f5aa180b6db start_thread at ??:0
I20260620 02:55:59.522819 971 tablet_service.cc:1467] Processing CreateTablet for tablet cc7f4ba88f254a26a63205fe13331249 (DEFAULT_TABLE table=default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:59.523301 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7f4ba88f254a26a63205fe13331249. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f5a9a7a161f clone at ??:0
I20260620 02:55:59.524895 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet 895f9db9d57140fda82e39b4fe631aaf with delete_type TABLET_DATA_DELETED (replaced by tablet cc7f4ba88f254a26a63205fe13331249) from {username='slave'} at 127.0.0.1:43338
I20260620 02:55:59.524963 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 9986f946441b4544b6acc01f7990468e with delete_type TABLET_DATA_DELETED (replaced by tablet 10fd34892bed4c78801d349e4f332f9c) from {username='slave'} at 127.0.0.1:43338
I20260620 02:55:59.525270 1908 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:59.525594 1250 tablet_service.cc:1467] Processing CreateTablet for tablet 0de4191c5bd74289b7ea8528f02a794c (DEFAULT_TABLE table=default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:59.526038 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de4191c5bd74289b7ea8528f02a794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:59.527201 1908 tablet_bootstrap.cc:654] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:59.531733 1910 tablet_replica.cc:330] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:59.531994 1910 raft_consensus.cc:2229] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:59.532222 1910 raft_consensus.cc:2258] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:59.532822 1910 ts_tablet_manager.cc:1905] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:59.535219 1248 tablet_service.cc:1467] Processing CreateTablet for tablet cc7f4ba88f254a26a63205fe13331249 (DEFAULT_TABLE table=default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:55:59.535761 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7f4ba88f254a26a63205fe13331249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:55:59.541905 1910 ts_tablet_manager.cc:1918] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:59.542038 1910 log.cc:1196] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/895f9db9d57140fda82e39b4fe631aaf
I20260620 02:55:59.542610 1910 ts_tablet_manager.cc:1939] T 895f9db9d57140fda82e39b4fe631aaf P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:59.543699 1910 tablet_replica.cc:330] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:55:59.543952 1910 raft_consensus.cc:2229] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:55:59.544150 1910 raft_consensus.cc:2258] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:59.544454 1912 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:59.545295 1910 ts_tablet_manager.cc:1905] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:59.545982 1904 tablet_replica.cc:330] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:55:59.546276 1904 raft_consensus.cc:2229] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:55:59.546667 1904 raft_consensus.cc:2258] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:55:59.547401 1904 ts_tablet_manager.cc:1905] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:55:59.548943 1912 tablet_bootstrap.cc:654] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:59.551620 1910 ts_tablet_manager.cc:1918] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:59.555331 1908 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:59.555480 1912 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:59.555533 1908 ts_tablet_manager.cc:1397] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.014s
I20260620 02:55:59.555688 1912 ts_tablet_manager.cc:1397] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260620 02:55:59.556409 1904 ts_tablet_manager.cc:1918] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:55:59.556666 1904 log.cc:1196] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/9986f946441b4544b6acc01f7990468e
I20260620 02:55:59.556481 1912 raft_consensus.cc:348] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.554956 1910 log.cc:1196] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/9986f946441b4544b6acc01f7990468e
I20260620 02:55:59.556754 1912 raft_consensus.cc:374] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:59.556941 1912 raft_consensus.cc:729] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:59.557164 1904 ts_tablet_manager.cc:1939] T 9986f946441b4544b6acc01f7990468e P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:55:59.557222 1910 ts_tablet_manager.cc:1939] T 9986f946441b4544b6acc01f7990468e P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:55:59.557355 1912 consensus_queue.cc:260] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.556496 1908 raft_consensus.cc:348] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.558104 1912 ts_tablet_manager.cc:1428] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:55:59.559172 1912 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:55:59.560918 1912 tablet_bootstrap.cc:654] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:59.561784 1908 raft_consensus.cc:374] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:59.561914 1908 raft_consensus.cc:729] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:59.562155 1908 consensus_queue.cc:260] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.562713 1908 ts_tablet_manager.cc:1428] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260620 02:55:59.564626 1908 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:55:59.566601 1908 tablet_bootstrap.cc:654] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:55:59.567022 1912 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:55:59.567220 1912 ts_tablet_manager.cc:1397] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260620 02:55:59.567992 1912 raft_consensus.cc:348] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.568285 1912 raft_consensus.cc:374] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:59.568409 1912 raft_consensus.cc:729] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:55:59.568708 1912 consensus_queue.cc:260] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.569530 1912 ts_tablet_manager.cc:1428] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:55:59.574949 1908 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:55:59.575099 1908 ts_tablet_manager.cc:1397] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260620 02:55:59.575739 1908 raft_consensus.cc:348] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.575964 1908 raft_consensus.cc:374] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:55:59.576067 1908 raft_consensus.cc:729] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:55:59.576309 1908 consensus_queue.cc:260] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.576817 1908 ts_tablet_manager.cc:1428] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 02:55:59.694303 1752 raft_consensus.cc:482] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:59.694540 1752 raft_consensus.cc:504] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.695281 1752 leader_election.cc:288] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:59.695911 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7f4ba88f254a26a63205fe13331249" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:55:59.696175 994 raft_consensus.cc:2454] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 0.
W20260620 02:55:59.696302 1207 leader_election.cc:341] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Not found: Tablet not found: cc7f4ba88f254a26a63205fe13331249
I20260620 02:55:59.696641 1204 leader_election.cc:302] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters: 880a5420b43045f4bfcf690b20dac3de
I20260620 02:55:59.696935 1752 raft_consensus.cc:2781] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:59.697058 1752 raft_consensus.cc:482] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:59.697167 1752 raft_consensus.cc:3037] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:59.699070 1752 raft_consensus.cc:504] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:55:59.699733 1752 leader_election.cc:288] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Requested vote from peers 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629), 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:55:59.700274 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7f4ba88f254a26a63205fe13331249" candidate_uuid: "6f967984189c40c8afe26a19f52b782e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:55:59.700549 994 raft_consensus.cc:3037] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
W20260620 02:55:59.700546 1207 leader_election.cc:341] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Not found: Tablet not found: cc7f4ba88f254a26a63205fe13331249
I20260620 02:55:59.702571 994 raft_consensus.cc:2454] T cc7f4ba88f254a26a63205fe13331249 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f967984189c40c8afe26a19f52b782e in term 1.
I20260620 02:55:59.702943 1204 leader_election.cc:302] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters: 880a5420b43045f4bfcf690b20dac3de
I20260620 02:55:59.703224 1752 raft_consensus.cc:2781] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:59.703727 1752 raft_consensus.cc:686] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Becoming Leader. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Running, Role: LEADER
I20260620 02:55:59.704084 1752 consensus_queue.cc:237] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
W20260620 02:55:59.742036 1204 connection.cc:535] server connection from 127.0.0.1:43338 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.742125 929 connection.cc:535] server connection from 127.0.0.1:32812 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.742552 1207 connection.cc:535] client connection to 127.0.97.60:33171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.742611 1329 connection.cc:535] client connection to 127.0.97.60:33171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.742714 1784 connection.cc:535] server connection from 127.0.0.1:39382 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.743251 1329 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.60:33171)
W20260620 02:55:59.743232 931 connection.cc:535] client connection to 127.0.97.60:33171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:55:59.744333 1329 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:33171)
W20260620 02:55:59.745209 1876 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:55:59.743930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.60:33171 (local address 127.0.97.3:34593)
0620 02:55:59.744202 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0620 02:55:59.744221 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0620 02:55:59.744352 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 02:55:59.744945 (+ 593us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":158}
W20260620 02:55:59.745373 1329 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:33171)
W20260620 02:55:59.745635 1329 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.60:33171)
I20260620 02:55:59.754791 1745 raft_consensus.cc:482] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:55:59.755003 1745 raft_consensus.cc:504] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.755622 1745 leader_election.cc:288] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:59.756168 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de4191c5bd74289b7ea8528f02a794c" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:55:59.756408 1270 raft_consensus.cc:2454] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
W20260620 02:55:59.756438 931 leader_election.cc:341] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Not found: Tablet not found: 0de4191c5bd74289b7ea8528f02a794c
I20260620 02:55:59.756876 931 leader_election.cc:302] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters: 880a5420b43045f4bfcf690b20dac3de
I20260620 02:55:59.757122 1745 raft_consensus.cc:2781] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:55:59.757279 1745 raft_consensus.cc:482] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:55:59.757365 1745 raft_consensus.cc:3037] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:55:59.759227 1745 raft_consensus.cc:504] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:55:59.760753 1745 leader_election.cc:288] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:55:59.761363 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de4191c5bd74289b7ea8528f02a794c" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:55:59.761564 1270 raft_consensus.cc:3037] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
W20260620 02:55:59.762223 931 leader_election.cc:341] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Not found: Tablet not found: 0de4191c5bd74289b7ea8528f02a794c
I20260620 02:55:59.763511 1270 raft_consensus.cc:2454] T 0de4191c5bd74289b7ea8528f02a794c P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:55:59.763942 931 leader_election.cc:302] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters: 880a5420b43045f4bfcf690b20dac3de
I20260620 02:55:59.764237 1745 raft_consensus.cc:2781] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:55:59.764657 1745 raft_consensus.cc:686] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:55:59.765036 1745 consensus_queue.cc:237] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:00.024966 1928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:00.025285 1928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:00.025983 1928 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:00.027944 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:00.028153 1785 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:00.028295 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:00.028774 1928 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 02:56:00.550571 1935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:00.550719 1935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:00.551303 1935 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:00.553296 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:00.554349 1785 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:00.554457 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:00.554649 1935 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 02:56:00.682057 1752 consensus_queue.cc:1035] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 02:56:00.689306 1207 consensus_peers.cc:487] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e -> Peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Couldn't send request to peer 880a5420b43045f4bfcf690b20dac3de. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc7f4ba88f254a26a63205fe13331249. This is attempt 1: this message will repeat every 5th retry.
I20260620 02:56:00.760872 1745 consensus_queue.cc:1035] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 02:56:00.765798 931 consensus_peers.cc:487] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd -> Peer 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): Couldn't send request to peer 880a5420b43045f4bfcf690b20dac3de. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0de4191c5bd74289b7ea8528f02a794c. This is attempt 1: this message will repeat every 5th retry.
I20260620 02:56:01.328415 1956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:01.328575 1956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:01.329274 1956 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:01.331447 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:01.331664 1785 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:01.331813 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:01.332134 1956 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 02:56:01.774220 1966 ts_tablet_manager.cc:927] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Initiating tablet copy from peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:01.775352 1966 tablet_copy_client.cc:316] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Beginning tablet copy session from remote peer at address 127.0.97.1:40979
I20260620 02:56:01.776582 1015 tablet_copy_service.cc:140] P 200c6cbcf0124308a686502d3ffd51bd: Received BeginTabletCopySession request for tablet 0de4191c5bd74289b7ea8528f02a794c from peer 880a5420b43045f4bfcf690b20dac3de ({username='slave'} at 127.0.97.2:57033)
I20260620 02:56:01.776815 1015 tablet_copy_service.cc:161] P 200c6cbcf0124308a686502d3ffd51bd: Beginning new tablet copy session on tablet 0de4191c5bd74289b7ea8528f02a794c from peer 880a5420b43045f4bfcf690b20dac3de at {username='slave'} at 127.0.97.2:57033: session id = 880a5420b43045f4bfcf690b20dac3de-0de4191c5bd74289b7ea8528f02a794c
I20260620 02:56:01.780349 1015 tablet_copy_source_session.cc:205] T 0de4191c5bd74289b7ea8528f02a794c P 200c6cbcf0124308a686502d3ffd51bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 02:56:01.782666 1966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de4191c5bd74289b7ea8528f02a794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:01.786880 1966 tablet_copy_client.cc:791] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Starting download of 0 data blocks...
I20260620 02:56:01.787187 1966 tablet_copy_client.cc:655] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Starting download of 1 WAL segments...
I20260620 02:56:01.789990 1966 tablet_copy_client.cc:531] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 02:56:01.792608 1966 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:01.797528 1966 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:56:01.797880 1966 tablet_bootstrap.cc:492] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Bootstrap complete.
I20260620 02:56:01.798055 1966 ts_tablet_manager.cc:1397] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.006s
I20260620 02:56:01.798651 1966 raft_consensus.cc:348] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:01.798827 1966 raft_consensus.cc:729] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:01.799054 1966 consensus_queue.cc:260] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:01.800101 1966 ts_tablet_manager.cc:1428] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:56:01.801469 1015 tablet_copy_service.cc:342] P 200c6cbcf0124308a686502d3ffd51bd: Request end of tablet copy session 880a5420b43045f4bfcf690b20dac3de-0de4191c5bd74289b7ea8528f02a794c received from {username='slave'} at 127.0.97.2:57033
I20260620 02:56:01.801663 1015 tablet_copy_service.cc:433] P 200c6cbcf0124308a686502d3ffd51bd: ending tablet copy session 880a5420b43045f4bfcf690b20dac3de-0de4191c5bd74289b7ea8528f02a794c on tablet 0de4191c5bd74289b7ea8528f02a794c with peer 880a5420b43045f4bfcf690b20dac3de
I20260620 02:56:01.871404 1951 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:01.871644 1951 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:01.872277 1951 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:01.873273 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:01.873440 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:01.873548 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:01.873756 1951 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:01.914750 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--webserver_interface=127.0.97.61
--webserver_port=38883
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:56:01.933324 1966 ts_tablet_manager.cc:927] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Initiating tablet copy from peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:01.934203 1966 tablet_copy_client.cc:316] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Beginning tablet copy session from remote peer at address 127.0.97.3:44643
I20260620 02:56:01.935388 1291 tablet_copy_service.cc:140] P 6f967984189c40c8afe26a19f52b782e: Received BeginTabletCopySession request for tablet cc7f4ba88f254a26a63205fe13331249 from peer 880a5420b43045f4bfcf690b20dac3de ({username='slave'} at 127.0.97.2:50797)
I20260620 02:56:01.935639 1291 tablet_copy_service.cc:161] P 6f967984189c40c8afe26a19f52b782e: Beginning new tablet copy session on tablet cc7f4ba88f254a26a63205fe13331249 from peer 880a5420b43045f4bfcf690b20dac3de at {username='slave'} at 127.0.97.2:50797: session id = 880a5420b43045f4bfcf690b20dac3de-cc7f4ba88f254a26a63205fe13331249
I20260620 02:56:01.938726 1291 tablet_copy_source_session.cc:205] T cc7f4ba88f254a26a63205fe13331249 P 6f967984189c40c8afe26a19f52b782e: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 02:56:01.940261 1966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7f4ba88f254a26a63205fe13331249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:01.945595 1966 tablet_copy_client.cc:791] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Starting download of 0 data blocks...
I20260620 02:56:01.945905 1966 tablet_copy_client.cc:655] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Starting download of 1 WAL segments...
I20260620 02:56:01.949208 1966 tablet_copy_client.cc:531] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 02:56:01.951893 1966 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:01.956493 1966 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:56:01.956880 1966 tablet_bootstrap.cc:492] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap complete.
I20260620 02:56:01.957166 1966 ts_tablet_manager.cc:1397] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.004s
I20260620 02:56:01.957842 1966 raft_consensus.cc:348] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:01.958068 1966 raft_consensus.cc:729] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:01.958400 1966 consensus_queue.cc:260] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:01.960825 1966 ts_tablet_manager.cc:1428] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 02:56:01.962639 1291 tablet_copy_service.cc:342] P 6f967984189c40c8afe26a19f52b782e: Request end of tablet copy session 880a5420b43045f4bfcf690b20dac3de-cc7f4ba88f254a26a63205fe13331249 received from {username='slave'} at 127.0.97.2:50797
I20260620 02:56:01.962831 1291 tablet_copy_service.cc:433] P 6f967984189c40c8afe26a19f52b782e: ending tablet copy session 880a5420b43045f4bfcf690b20dac3de-cc7f4ba88f254a26a63205fe13331249 on tablet cc7f4ba88f254a26a63205fe13331249 with peer 880a5420b43045f4bfcf690b20dac3de
I20260620 02:56:02.006930 1972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:02.007097 1972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:02.007786 1972 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:02.009806 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:02.010502 1785 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:02.010638 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:02.011060 1972 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 02:56:02.039244 1951 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:02.039425 1951 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:02.040113 1951 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:02.040995 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:02.041131 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:02.041347 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:02.041846 1951 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 02:56:02.251099 1969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:02.251518 1969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:02.251639 1969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:02.258886 1969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:02.258983 1969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:02.259054 1969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:02.259140 1969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:02.268388 1969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=38883
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:02.269759 1969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:02.271521 1969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:02.285131 1984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:02.284948 1985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:02.284919 1987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:02.285662 1969 server_base.cc:1034] running on GCE node
I20260620 02:56:02.286451 1969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:02.287768 1969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:02.289011 1969 hybrid_clock.cc:648] HybridClock initialized: now 1781924162288914 us; error 54 us; skew 500 ppm
I20260620 02:56:02.289402 1969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:02.295758 1969 webserver.cc:460] Webserver started at http://127.0.97.61:38883/ using document root <none> and password file <none>
I20260620 02:56:02.296470 1969 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:02.296638 1969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:02.302136 1969 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260620 02:56:02.305153 1993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:02.306746 1969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260620 02:56:02.306921 1969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:56:02.307839 1969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:02.330273 1969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:02.331399 1969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:02.331758 1969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:02.354012 1969 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:34445
I20260620 02:56:02.354019 2044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:34445 every 8 connection(s)
I20260620 02:56:02.355496 1969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
I20260620 02:56:02.362213 2045 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:02.362931 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 1969
I20260620 02:56:02.367195 2045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap starting.
I20260620 02:56:02.387809 2045 log.cc:824] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:02.448685 2045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=76 overwritten=0 applied=76 ignored=0} inserts{seen=52 ignored=0} mutations{seen=59 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:56:02.449380 2045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap complete.
I20260620 02:56:02.457698 2045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:02.458693 2045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Initialized, Role: FOLLOWER
I20260620 02:56:02.459362 2045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 76, Last appended: 3.76, Last appended by leader: 76, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:02.460204 2050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:02.460584 2050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:02.461416 2045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:02.474058 1179 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:02.495148 2066 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:02.497473 2066 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: loading cluster ID for follower catalog manager: success
I20260620 02:56:02.515939 2066 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: acquiring CA information for follower catalog manager: success
I20260620 02:56:02.524386 2066 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:02.530053 1969 master_runner.cc:186] Error getting master registration for 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111),
I20260620 02:56:02.537098 1969 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:02.704444 1130 raft_consensus.cc:1203] T 0de4191c5bd74289b7ea8528f02a794c P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260620 02:56:02.710047 2010 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:43785; Asking this server to re-register.
I20260620 02:56:02.710865 1179 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:02.713011 2010 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:02.715943 1042 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:02.718369 2010 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:41803; Asking this server to re-register.
I20260620 02:56:02.719130 1042 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:02.720592 2010 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:02.783157 1318 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:02.785319 2010 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:44099; Asking this server to re-register.
I20260620 02:56:02.785986 1318 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:02.787535 2010 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:02.943889 2050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:02.944181 2050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:02.946197 2050 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:02.946682 1809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
W20260620 02:56:02.946887 1997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:02.947032 1809 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38d9721548804411b8e68a41e247d9a8 in current term 4: Already voted for candidate 88f31390712542bf916d639cd0e4a435 in this term.
W20260620 02:56:02.948359 1997 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:02.948549 1997 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:02.948873 2050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 3 FOLLOWER]: Advancing to term 4
I20260620 02:56:02.953192 2050 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 02:56:03.116223 1130 raft_consensus.cc:1203] T cc7f4ba88f254a26a63205fe13331249 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260620 02:56:03.217680 2078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:03.217849 2078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:03.218595 2078 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:03.221197 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:03.225482 2020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 81 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:56:03.225881 2020 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 4.
I20260620 02:56:03.226274 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 88f31390712542bf916d639cd0e4a435
I20260620 02:56:03.226518 2078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 02:56:03.226631 2078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:03.226706 2078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 4 FOLLOWER]: Advancing to term 5
I20260620 02:56:03.228591 2078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:03.229105 2078 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 election: Requested vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:03.229496 2020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 81 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8"
I20260620 02:56:03.229686 2020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 4 FOLLOWER]: Advancing to term 5
W20260620 02:56:03.230415 1786 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:03.231761 2020 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 5.
I20260620 02:56:03.232209 1785 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 88f31390712542bf916d639cd0e4a435
I20260620 02:56:03.232551 2078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Leader election won for term 5
I20260620 02:56:03.232969 2078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 LEADER]: Becoming Leader. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Running, Role: LEADER
I20260620 02:56:03.233428 2078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 4.81, Last appended by leader: 81, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:03.235071 2082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 5 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:03.235363 2082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:03.236032 2084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:56:03.239071 2084 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:56:03.239749 2084 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:56:03.240092 2084 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:56:03.240437 2084 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:56:03.240756 2084 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:56:03.241086 2084 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:56:03.241463 2084 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:56:03.241783 2084 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:56:03.242085 2084 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:56:03.242477 2084 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:56:03.242800 2084 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:56:03.243173 2084 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:56:03.243551 2084 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:56:03.243893 2084 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:56:03.245805 2084 tablet_loader.cc:96] loaded metadata for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:56:03.246160 2084 tablet_loader.cc:96] loaded metadata for tablet 0de4191c5bd74289b7ea8528f02a794c (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:56:03.246480 2084 tablet_loader.cc:96] loaded metadata for tablet 10fd34892bed4c78801d349e4f332f9c (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:56:03.246913 2084 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:56:03.247217 2084 tablet_loader.cc:96] loaded metadata for tablet 4b05d8ae218e4455902714f556589aea (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:56:03.247516 2084 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:56:03.247802 2084 tablet_loader.cc:96] loaded metadata for tablet 60d4ef253c6f4e5397187e78231b5503 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:56:03.248081 2084 tablet_loader.cc:96] loaded metadata for tablet 6acad10256014c42a04a87c7fbb0d68a (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:56:03.248664 2084 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:56:03.249523 2084 tablet_loader.cc:96] loaded metadata for tablet ac066f4fd56c4e439d0bf1ff09067717 (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:56:03.249866 2084 tablet_loader.cc:96] loaded metadata for tablet ae99f00924a84045b5f18f23a96421e9 (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:56:03.250295 2084 tablet_loader.cc:96] loaded metadata for tablet cc7f4ba88f254a26a63205fe13331249 (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:56:03.250738 2084 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:56:03.251050 2084 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:56:03.251705 2084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:56:03.252961 2084 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:03.253058 2084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:56:03.254873 2084 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:56:03.256155 2084 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Loaded TSK: 0
I20260620 02:56:03.257051 2084 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:56:03.258208 2084 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:56:03.259536 2084 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:56:03.266515 1799 master_service.cc:946] ReplaceTablet: received request to replace tablet 4b05d8ae218e4455902714f556589aea from {username='slave'} at 127.0.0.1:39366
I20260620 02:56:03.266642 1797 master_service.cc:946] ReplaceTablet: received request to replace tablet ac066f4fd56c4e439d0bf1ff09067717 from {username='slave'} at 127.0.0.1:39366
I20260620 02:56:03.267659 1795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_c8a7ae199f32436d8fd09b4aad018b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.267746 1793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_5fe1f2b14780430cb07cfd13f5ea91c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.268604 1792 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_50de7b3586d54bcd96eaa04479c238c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.269469 1798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_0c6fd9cb1b4c46f1bf1d51a97c26196a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.269934 1791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_bedc0a11a14744d3a493a3239abf429b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.269948 1796 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_0c298c487d434f67b0a47a53292c42a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.270303 1794 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_1550ec9bf27b4226877f1c598bc58599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.270876 1790 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39366:
name: "default.Table_4de3fc606f0549218237315827ac3a45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:03.280015 1855 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
I20260620 02:56:03.280576 2020 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Refusing update from remote peer 7e68099b11fb4e71a63f9749ec9da6bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 76. Preceding OpId from leader: term: 5 index: 84. (index mismatch)
W20260620 02:56:03.280548 1855 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:56:03.281069 1855 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
W20260620 02:56:03.281039 1786 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf -> Peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Couldn't send request to peer 88f31390712542bf916d639cd0e4a435. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
*** Check failure stack trace: ***
I20260620 02:56:03.281616 2082 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 76, Time since last communication: 0.000s
@ 0x7f8bc9e419ad google::LogMessage::Fail() at ??:0
@ 0x7f8bc9e4488a google::LogMessage::SendToLog() at ??:0
@ 0x7f8bc9e414de google::LogMessage::Flush() at ??:0
@ 0x7f8bc9e416d1 google::LogMessage::~LogMessage() at ??:0
I20260620 02:56:03.293397 2088 mvcc.cc:205] Tried to move back new op lower bound from 7298761357081825280 to 7298761356656721920. Current Snapshot: MvccSnapshot[applied={T|T < 7298761357081825280 or (T in {7298761357081825280})}]
@ 0x7f8bdf9dfba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 02:56:03.296130 2050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 5 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:03.296380 2050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:03.296607 2090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:03.296798 2090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:03.298544 2090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:03.298761 2090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:03.301668 1797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet ac066f4fd56c4e439d0bf1ff09067717
I20260620 02:56:03.302786 1799 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet 4b05d8ae218e4455902714f556589aea
I20260620 02:56:03.303596 1797 catalog_manager.cc:6565] ReplaceTablet: tablet ac066f4fd56c4e439d0bf1ff09067717 deleted and replaced by tablet e017ff28be7c46de9808c7d0c469686b
I20260620 02:56:03.303627 1799 catalog_manager.cc:6565] ReplaceTablet: tablet 4b05d8ae218e4455902714f556589aea deleted and replaced by tablet 469a4fbe58c143f7a86907b02fcfa8ba
@ 0x7f8bdf9de901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:56:03.325752 1799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39366:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
@ 0x7f8bdf9e566c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 02:56:03.329152 2082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:03.329543 2082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:03.331491 1799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39366:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:56:03.332257 1797 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39366:
table { table_name: "default.Table_93f177252a6c4a49b1c2cd213cc0e1ba" } new_table_name: "default.Table_be09d676a02748338b4b22de5b701eb0" modify_external_catalogs: true
I20260620 02:56:03.333722 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 with delete_type TABLET_DATA_DELETED (replaced by tablet e017ff28be7c46de9808c7d0c469686b) from {username='slave'} at 127.0.0.1:44974
I20260620 02:56:03.333722 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b05d8ae218e4455902714f556589aea with delete_type TABLET_DATA_DELETED (replaced by tablet 469a4fbe58c143f7a86907b02fcfa8ba) from {username='slave'} at 127.0.0.1:44974
I20260620 02:56:03.334378 2103 tablet_replica.cc:330] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:56:03.334635 2103 raft_consensus.cc:2229] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:56:03.335035 2103 raft_consensus.cc:2258] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.335700 2103 ts_tablet_manager.cc:1905] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f8bdf9e54e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 02:56:03.342374 971 tablet_service.cc:1514] Processing DeleteTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 with delete_type TABLET_DATA_DELETED (replaced by tablet e017ff28be7c46de9808c7d0c469686b) from {username='slave'} at 127.0.0.1:46524
I20260620 02:56:03.343621 975 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b05d8ae218e4455902714f556589aea with delete_type TABLET_DATA_DELETED (replaced by tablet 469a4fbe58c143f7a86907b02fcfa8ba) from {username='slave'} at 127.0.0.1:46524
I20260620 02:56:03.346474 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b05d8ae218e4455902714f556589aea with delete_type TABLET_DATA_DELETED (replaced by tablet 469a4fbe58c143f7a86907b02fcfa8ba) from {username='slave'} at 127.0.0.1:38544
@ 0x7f8bcca6beaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:56:03.346889 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet ac066f4fd56c4e439d0bf1ff09067717 with delete_type TABLET_DATA_DELETED (replaced by tablet e017ff28be7c46de9808c7d0c469686b) from {username='slave'} at 127.0.0.1:38544
@ 0x7f8bcfd456db start_thread at ??:0
@ 0x7f8bc8cdb61f clone at ??:0
I20260620 02:56:03.351460 1110 tablet_service.cc:1467] Processing CreateTablet for tablet 469a4fbe58c143f7a86907b02fcfa8ba (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.351611 1248 tablet_service.cc:1467] Processing CreateTablet for tablet 469a4fbe58c143f7a86907b02fcfa8ba (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.351914 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469a4fbe58c143f7a86907b02fcfa8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.351899 1251 tablet_service.cc:1467] Processing CreateTablet for tablet e017ff28be7c46de9808c7d0c469686b (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.352005 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469a4fbe58c143f7a86907b02fcfa8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.352250 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e017ff28be7c46de9808c7d0c469686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.354306 975 tablet_service.cc:1467] Processing CreateTablet for tablet 469a4fbe58c143f7a86907b02fcfa8ba (DEFAULT_TABLE table=default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.354679 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469a4fbe58c143f7a86907b02fcfa8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.357556 1108 tablet_service.cc:1467] Processing CreateTablet for tablet e017ff28be7c46de9808c7d0c469686b (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.357905 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e017ff28be7c46de9808c7d0c469686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.366187 972 tablet_service.cc:1467] Processing CreateTablet for tablet e017ff28be7c46de9808c7d0c469686b (DEFAULT_TABLE table=default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:03.366761 972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e017ff28be7c46de9808c7d0c469686b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:03.371186 2110 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:03.373150 2110 tablet_bootstrap.cc:654] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.394703 2103 ts_tablet_manager.cc:1918] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.394873 2103 log.cc:1196] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/ac066f4fd56c4e439d0bf1ff09067717
I20260620 02:56:03.398694 2103 ts_tablet_manager.cc:1939] T ac066f4fd56c4e439d0bf1ff09067717 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:56:03.399755 2103 tablet_replica.cc:330] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:56:03.400036 2103 raft_consensus.cc:2229] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:03.400246 2103 raft_consensus.cc:2258] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.400959 2103 ts_tablet_manager.cc:1905] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:03.407593 2112 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:56:03.409979 2112 tablet_bootstrap.cc:654] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.413478 2107 tablet_replica.cc:330] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:56:03.413767 2107 raft_consensus.cc:2229] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:03.414053 2107 raft_consensus.cc:2258] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.414788 2107 ts_tablet_manager.cc:1905] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:03.417721 2105 tablet_replica.cc:330] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:56:03.417971 2105 raft_consensus.cc:2229] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:03.418233 2105 raft_consensus.cc:2258] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.418927 2105 ts_tablet_manager.cc:1905] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:03.422036 2109 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:56:03.423285 2109 tablet_bootstrap.cc:654] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.425598 2112 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:56:03.425611 2110 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:56:03.425725 2112 ts_tablet_manager.cc:1397] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260620 02:56:03.425742 2110 ts_tablet_manager.cc:1397] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.055s user 0.013s sys 0.038s
I20260620 02:56:03.426509 2112 raft_consensus.cc:348] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.426762 2112 raft_consensus.cc:374] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.426535 2110 raft_consensus.cc:348] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.426846 2112 raft_consensus.cc:729] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.426860 2110 raft_consensus.cc:374] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.426956 2110 raft_consensus.cc:729] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.427078 2112 consensus_queue.cc:260] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.427208 2110 consensus_queue.cc:260] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.429134 2110 ts_tablet_manager.cc:1428] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:56:03.429421 2110 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:03.430961 2110 tablet_bootstrap.cc:654] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.442544 2103 ts_tablet_manager.cc:1918] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.442689 2103 log.cc:1196] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/4b05d8ae218e4455902714f556589aea
I20260620 02:56:03.443131 2103 ts_tablet_manager.cc:1939] T 4b05d8ae218e4455902714f556589aea P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:56:03.446702 2112 ts_tablet_manager.cc:1428] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260620 02:56:03.451200 2112 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:56:03.451254 2110 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:56:03.451421 2110 ts_tablet_manager.cc:1397] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.009s
I20260620 02:56:03.452201 2110 raft_consensus.cc:348] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.452440 2110 raft_consensus.cc:374] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.452497 2112 tablet_bootstrap.cc:654] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.452519 2110 raft_consensus.cc:729] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.452756 2110 consensus_queue.cc:260] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.453385 2110 ts_tablet_manager.cc:1428] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 02:56:03.455806 2107 ts_tablet_manager.cc:1918] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.455927 2107 log.cc:1196] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/4b05d8ae218e4455902714f556589aea
I20260620 02:56:03.456349 2107 ts_tablet_manager.cc:1939] T 4b05d8ae218e4455902714f556589aea P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:56:03.457793 2109 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:56:03.457928 2109 ts_tablet_manager.cc:1397] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260620 02:56:03.458681 2109 raft_consensus.cc:348] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.458899 2109 raft_consensus.cc:374] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.458997 2109 raft_consensus.cc:729] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.459242 2109 consensus_queue.cc:260] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.460587 2109 ts_tablet_manager.cc:1428] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:56:03.461391 2107 tablet_replica.cc:330] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:56:03.461644 2107 raft_consensus.cc:2229] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:03.461819 2107 raft_consensus.cc:2258] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.462364 2107 ts_tablet_manager.cc:1905] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:03.466423 2109 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:56:03.468087 2109 tablet_bootstrap.cc:654] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:03.469187 2107 ts_tablet_manager.cc:1918] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.469347 2107 log.cc:1196] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/ac066f4fd56c4e439d0bf1ff09067717
I20260620 02:56:03.469787 2107 ts_tablet_manager.cc:1939] T ac066f4fd56c4e439d0bf1ff09067717 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:56:03.470441 2112 tablet_bootstrap.cc:492] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:56:03.470599 2112 ts_tablet_manager.cc:1397] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260620 02:56:03.471156 2112 raft_consensus.cc:348] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.471340 2112 raft_consensus.cc:374] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.471396 2112 raft_consensus.cc:729] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.471607 2112 consensus_queue.cc:260] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.472121 2112 ts_tablet_manager.cc:1428] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 02:56:03.476071 2105 ts_tablet_manager.cc:1918] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.476181 2105 log.cc:1196] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/ac066f4fd56c4e439d0bf1ff09067717
I20260620 02:56:03.476627 2105 ts_tablet_manager.cc:1939] T ac066f4fd56c4e439d0bf1ff09067717 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:56:03.477313 2105 tablet_replica.cc:330] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:56:03.477469 2105 raft_consensus.cc:2229] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:56:03.477659 2105 raft_consensus.cc:2258] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:03.478088 2105 ts_tablet_manager.cc:1905] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:03.485078 2105 ts_tablet_manager.cc:1918] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:03.485296 2105 log.cc:1196] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/4b05d8ae218e4455902714f556589aea
I20260620 02:56:03.485757 2105 ts_tablet_manager.cc:1939] T 4b05d8ae218e4455902714f556589aea P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:56:03.488214 2109 tablet_bootstrap.cc:492] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:56:03.488334 2109 ts_tablet_manager.cc:1397] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.003s
I20260620 02:56:03.488852 2109 raft_consensus.cc:348] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.489084 2109 raft_consensus.cc:374] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:03.489138 2109 raft_consensus.cc:729] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:56:03.489370 2109 consensus_queue.cc:260] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.489886 2109 ts_tablet_manager.cc:1428] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260620 02:56:03.535917 1948 raft_consensus.cc:482] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:03.536181 1948 raft_consensus.cc:504] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.537055 1948 leader_election.cc:288] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:03.537564 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e017ff28be7c46de9808c7d0c469686b" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:56:03.537575 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e017ff28be7c46de9808c7d0c469686b" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:56:03.537820 1130 raft_consensus.cc:2454] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:03.537847 1270 raft_consensus.cc:2454] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:03.538369 931 leader_election.cc:302] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:56:03.538666 1948 raft_consensus.cc:2781] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:56:03.538801 1948 raft_consensus.cc:482] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:03.538892 1948 raft_consensus.cc:3037] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.541980 1948 raft_consensus.cc:504] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.542632 1948 leader_election.cc:288] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:03.543059 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e017ff28be7c46de9808c7d0c469686b" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:56:03.543167 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e017ff28be7c46de9808c7d0c469686b" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:56:03.543334 1270 raft_consensus.cc:3037] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.543350 1130 raft_consensus.cc:3037] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.545449 1130 raft_consensus.cc:2454] T e017ff28be7c46de9808c7d0c469686b P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:03.545819 931 leader_election.cc:302] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:03.546066 1948 raft_consensus.cc:2781] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:56:03.546368 1270 raft_consensus.cc:2454] T e017ff28be7c46de9808c7d0c469686b P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:03.546566 1948 raft_consensus.cc:686] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:56:03.546886 1948 consensus_queue.cc:237] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
W20260620 02:56:03.616317 930 connection.cc:535] server connection from 127.0.0.1:46524 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616317 1207 connection.cc:535] server connection from 127.0.0.1:38544 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616394 1067 connection.cc:535] server connection from 127.0.0.1:44974 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616611 1206 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616600 930 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616616 1067 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.616941 1328 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:03.617590 1328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:46739)
W20260620 02:56:03.618005 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:46739)
W20260620 02:56:03.618613 1328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:46739)
W20260620 02:56:03.619104 1328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:46739)
I20260620 02:56:03.835556 2125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:03.835812 2125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:03.836457 2125 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:03.838654 1997 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:03.838910 1996 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:03.839087 1996 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:03.839340 2125 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 02:56:03.939118 1948 raft_consensus.cc:482] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:03.939330 1948 raft_consensus.cc:504] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.939905 1948 leader_election.cc:288] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:03.940483 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469a4fbe58c143f7a86907b02fcfa8ba" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:56:03.940464 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469a4fbe58c143f7a86907b02fcfa8ba" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:56:03.940706 1270 raft_consensus.cc:2454] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:03.940732 1130 raft_consensus.cc:2454] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:03.941121 931 leader_election.cc:302] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:03.941401 1948 raft_consensus.cc:2781] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:56:03.941504 1948 raft_consensus.cc:482] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:03.941596 1948 raft_consensus.cc:3037] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.944263 1948 raft_consensus.cc:504] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:03.944777 1948 leader_election.cc:288] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:03.945339 1130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469a4fbe58c143f7a86907b02fcfa8ba" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:56:03.945573 1130 raft_consensus.cc:3037] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.945685 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469a4fbe58c143f7a86907b02fcfa8ba" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:56:03.945883 1270 raft_consensus.cc:3037] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:03.948446 1270 raft_consensus.cc:2454] T 469a4fbe58c143f7a86907b02fcfa8ba P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:03.948437 1130 raft_consensus.cc:2454] T 469a4fbe58c143f7a86907b02fcfa8ba P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:03.948844 931 leader_election.cc:302] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:03.949065 1948 raft_consensus.cc:2781] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:56:03.949292 1948 raft_consensus.cc:686] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:56:03.950006 1948 consensus_queue.cc:237] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:04.328723 1948 consensus_queue.cc:1035] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:04.334194 1948 consensus_queue.cc:1035] T e017ff28be7c46de9808c7d0c469686b P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:04.390471 2140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:04.390661 2140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:04.391315 2140 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:04.393193 1997 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:04.393414 1996 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:04.393563 1996 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:04.393817 2140 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 02:56:04.794634 2135 consensus_queue.cc:1035] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:04.800673 1948 consensus_queue.cc:1035] T 469a4fbe58c143f7a86907b02fcfa8ba P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:04.859122 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu pid 1969
I20260620 02:56:04.866230 2040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 02:56:04.974838 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu with pid 1969
I20260620 02:56:05.038885 2131 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:05.039247 2131 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:05.040150 2131 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:05.041134 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:05.041342 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:05.041478 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:05.041694 2131 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:05.864323 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--webserver_interface=127.0.97.61
--webserver_port=38883
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:56:05.909838 2131 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:05.910204 2131 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:05.911072 2131 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:05.912213 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:05.912372 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:05.912506 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:05.912920 2131 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 02:56:06.187177 2154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:06.187461 2154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:06.187595 2154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:06.194959 2154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:06.195051 2154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:06.195137 2154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:06.195232 2154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:06.204674 2154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=38883
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:06.206092 2154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:06.207892 2154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:06.219520 2159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:06.219601 2160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:06.219765 2162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:06.220489 2154 server_base.cc:1034] running on GCE node
I20260620 02:56:06.221206 2154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:06.222539 2154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:06.223807 2154 hybrid_clock.cc:648] HybridClock initialized: now 1781924166223743 us; error 35 us; skew 500 ppm
I20260620 02:56:06.224172 2154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:06.226392 2154 webserver.cc:460] Webserver started at http://127.0.97.61:38883/ using document root <none> and password file <none>
I20260620 02:56:06.227044 2154 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:06.227185 2154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:06.232017 2154 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260620 02:56:06.234874 2168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:06.236085 2154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260620 02:56:06.236263 2154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:56:06.237185 2154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:06.293545 2154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:06.294435 2154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:06.294742 2154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:06.315456 2154 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:34445
I20260620 02:56:06.315477 2220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:34445 every 8 connection(s)
I20260620 02:56:06.316872 2154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
I20260620 02:56:06.321902 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 2154
I20260620 02:56:06.323553 2221 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:06.330145 2221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap starting.
I20260620 02:56:06.348160 2221 log.cc:824] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:06.416947 2221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=56 ignored=0} mutations{seen=68 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:56:06.417508 2221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap complete.
I20260620 02:56:06.424787 2221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:06.425693 2221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Initialized, Role: FOLLOWER
I20260620 02:56:06.426206 2221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 5.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:06.427073 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:06.427443 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:06.428000 2221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:06.440212 2240 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:06.440400 2240 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: loading cluster ID for follower catalog manager: success
I20260620 02:56:06.446722 2240 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: acquiring CA information for follower catalog manager: success
I20260620 02:56:06.450367 2240 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:06.452037 2154 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:06.461822 2154 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:06.514755 1042 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:06.518982 2185 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:52481; Asking this server to re-register.
I20260620 02:56:06.519685 1042 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:06.521636 2185 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:06.812309 1179 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:06.814003 2185 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:37207; Asking this server to re-register.
I20260620 02:56:06.814605 1179 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:06.816301 2185 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:06.816707 1318 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:06.817965 2185 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:33205; Asking this server to re-register.
I20260620 02:56:06.818467 1318 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:06.820034 2185 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:06.852250 2226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:06.852514 2226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:06.854264 2226 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:06.854943 2171 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:06.856850 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:06.857074 2172 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:06.857264 2172 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:06.857652 2226 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 02:56:07.531235 2255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:07.531411 2255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:07.532142 2255 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:07.534153 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:07.534353 2172 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:07.534482 2172 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:07.534716 2255 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 02:56:08.204178 2265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:08.204396 2265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:08.204974 2265 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:08.207175 2172 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:08.207401 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:08.207608 2171 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:08.207871 2265 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 02:56:09.425757 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--webserver_interface=127.0.97.60
--webserver_port=39951
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:56:09.614573 2287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:09.614780 2287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:09.615449 2287 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:09.617671 2172 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:09.617837 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:09.617944 2172 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:09.618206 2287 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 02:56:09.755841 2284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:09.756093 2284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:09.756167 2284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:09.763191 2284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:09.763288 2284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:09.763330 2284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:09.763386 2284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:09.772138 2284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:33171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=39951
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:09.773334 2284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:09.774915 2284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:09.786770 2295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:09.786748 2296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:09.786705 2298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:09.787712 2284 server_base.cc:1034] running on GCE node
I20260620 02:56:09.788549 2284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:09.789937 2284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:09.791206 2284 hybrid_clock.cc:648] HybridClock initialized: now 1781924169791119 us; error 54 us; skew 500 ppm
I20260620 02:56:09.791546 2284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:09.793852 2284 webserver.cc:460] Webserver started at http://127.0.97.60:39951/ using document root <none> and password file <none>
I20260620 02:56:09.794489 2284 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:09.794628 2284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:09.799549 2284 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260620 02:56:09.802891 2304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:09.804178 2284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 02:56:09.804386 2284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
uuid: "88f31390712542bf916d639cd0e4a435"
format_stamp: "Formatted at 2026-06-20 02:55:50 on dist-test-slave-w01b"
I20260620 02:56:09.805311 2284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:09.820544 2284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:09.821493 2284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:09.821841 2284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:09.848249 2284 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:33171
I20260620 02:56:09.848280 2359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:33171 every 8 connection(s)
I20260620 02:56:09.849711 2284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-2/data/info.pb
I20260620 02:56:09.853235 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 2284
I20260620 02:56:09.857287 2360 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:09.860908 2360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap starting.
I20260620 02:56:09.876065 2360 log.cc:824] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:09.932286 2360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap replayed 1/1 log segments. Stats: ops{read=81 overwritten=0 applied=80 ignored=0} inserts{seen=54 ignored=0} mutations{seen=63 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 02:56:09.932943 2360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Bootstrap complete.
I20260620 02:56:09.943229 2360 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:09.946576 2360 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f31390712542bf916d639cd0e4a435, State: Initialized, Role: FOLLOWER
I20260620 02:56:09.947233 2360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 80, Last appended: 4.81, Last appended by leader: 81, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:09.948035 2365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:09.948390 2365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:09.949004 2360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:09.969009 2379 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:09.969138 2379 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: loading cluster ID for follower catalog manager: success
I20260620 02:56:09.972915 2379 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: acquiring CA information for follower catalog manager: success
I20260620 02:56:09.975231 2379 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:09.966747 2284 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:09.976735 2284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:10.035701 1040 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:56:10.039518 2325 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:52919; Asking this server to re-register.
I20260620 02:56:10.040333 1040 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:10.042558 2325 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:10.324450 1316 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:56:10.326248 1177 heartbeater.cc:347] Connected to a master server at 127.0.97.60:33171
I20260620 02:56:10.326817 2325 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:47795; Asking this server to re-register.
I20260620 02:56:10.327687 1316 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:10.328511 2325 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:48917; Asking this server to re-register.
I20260620 02:56:10.329337 1177 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:10.329635 2324 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:10.330785 2324 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:10.369915 2365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:10.370214 2365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:10.372242 2365 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:56:10.373096 2307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:10.375456 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:10.379999 2196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 5 candidate_status { last_received { term: 4 index: 81 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:56:10.380481 2196 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88f31390712542bf916d639cd0e4a435 in current term 5: Already voted for candidate 7e68099b11fb4e71a63f9749ec9da6bf in this term.
I20260620 02:56:10.381397 2307 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:56:10.381850 2365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 4 FOLLOWER]: Advancing to term 5
I20260620 02:56:10.385231 2365 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 02:56:10.778291 2385 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:10.778487 2385 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:10.779348 2385 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:10.780236 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:10.780447 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:10.780541 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:10.780738 2385 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:10.961812 2391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:10.961993 2391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:10.962608 2391 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:10.965495 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:10.970032 2335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 85 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435" is_pre_election: true
I20260620 02:56:10.970438 2335 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 5.
I20260620 02:56:10.971071 2172 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435; no voters: 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:56:10.971390 2391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 02:56:10.971572 2391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:10.971710 2391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 5 FOLLOWER]: Advancing to term 6
I20260620 02:56:10.975756 2391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:10.976641 2391 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 election: Requested vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:10.976956 2335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 85 } } ignore_live_leader: false dest_uuid: "88f31390712542bf916d639cd0e4a435"
I20260620 02:56:10.977173 2335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 5 FOLLOWER]: Advancing to term 6
W20260620 02:56:10.977865 2171 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:10.979301 2335 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d9721548804411b8e68a41e247d9a8 in term 6.
I20260620 02:56:10.979712 2172 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435; no voters: 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:56:10.979976 2391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 02:56:10.980417 2391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 LEADER]: Becoming Leader. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Running, Role: LEADER
I20260620 02:56:10.980850 2391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 5.85, Last appended by leader: 85, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:10.983285 2396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 6 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:10.983561 2396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:10.984222 2398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:56:10.986820 2398 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:56:10.987483 2398 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:56:10.987821 2398 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:56:10.988153 2398 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:56:10.988469 2398 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:56:10.988795 2398 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:56:10.989152 2398 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:56:10.989506 2398 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:56:10.989805 2398 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:56:10.990136 2398 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:56:10.990447 2398 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:56:10.990760 2398 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:56:10.991078 2398 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:56:10.991402 2398 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:56:10.993106 2398 tablet_loader.cc:96] loaded metadata for tablet 0b621af903534b51b89d0bc0e5f555f8 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:56:10.993491 2398 tablet_loader.cc:96] loaded metadata for tablet 0de4191c5bd74289b7ea8528f02a794c (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:56:10.993847 2398 tablet_loader.cc:96] loaded metadata for tablet 10fd34892bed4c78801d349e4f332f9c (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:56:10.994488 2398 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:56:10.994843 2398 tablet_loader.cc:96] loaded metadata for tablet 469a4fbe58c143f7a86907b02fcfa8ba (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:56:10.995457 2398 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:56:10.995774 2398 tablet_loader.cc:96] loaded metadata for tablet 60d4ef253c6f4e5397187e78231b5503 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:56:10.996094 2398 tablet_loader.cc:96] loaded metadata for tablet 6acad10256014c42a04a87c7fbb0d68a (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:56:10.996727 2398 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:56:10.997972 2398 tablet_loader.cc:96] loaded metadata for tablet ae99f00924a84045b5f18f23a96421e9 (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:56:10.998594 2398 tablet_loader.cc:96] loaded metadata for tablet cc7f4ba88f254a26a63205fe13331249 (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:56:10.999018 2398 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:56:10.999228 2398 tablet_loader.cc:96] loaded metadata for tablet e017ff28be7c46de9808c7d0c469686b (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:56:10.999470 2398 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:56:11.000016 2398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:56:11.001471 2398 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:11.001538 2398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:56:11.002969 2398 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:56:11.004102 2398 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Loaded TSK: 0
I20260620 02:56:11.004927 2398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:56:11.006155 2398 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:56:11.007369 2398 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:56:11.124800 2185 master_service.cc:946] ReplaceTablet: received request to replace tablet 469a4fbe58c143f7a86907b02fcfa8ba from {username='slave'} at 127.0.0.1:42142
I20260620 02:56:11.125000 2186 master_service.cc:946] ReplaceTablet: received request to replace tablet 0b621af903534b51b89d0bc0e5f555f8 from {username='slave'} at 127.0.0.1:42142
I20260620 02:56:11.125484 2182 master_service.cc:946] ReplaceTablet: received request to replace tablet 6acad10256014c42a04a87c7fbb0d68a from {username='slave'} at 127.0.0.1:42142
I20260620 02:56:11.125860 2183 master_service.cc:946] ReplaceTablet: received request to replace tablet 60d4ef253c6f4e5397187e78231b5503 from {username='slave'} at 127.0.0.1:42142
I20260620 02:56:11.126108 2184 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42142:
name: "default.Table_ceb67d36056c496181ada59dce624540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:11.127842 2181 master_service.cc:946] ReplaceTablet: received request to replace tablet 800b61cdbfba4a52bfd6cc885afcdbe6 from {username='slave'} at 127.0.0.1:42142
I20260620 02:56:11.128909 2181 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_4377b6cf14a84e548766cd36e6fc68e0" } new_table_name: "default.Table_59f7fde270354419ba554c2cdb50b188" modify_external_catalogs: true
I20260620 02:56:11.129786 2180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
I20260620 02:56:11.130128 2180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_25240b69cc014c1d839a035fc97f6736" } modify_external_catalogs: true
I20260620 02:56:11.130606 2179 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:56:11.130911 2179 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_b944e69346c54bf09bf73e3939fdfaba" } modify_external_catalogs: true
I20260620 02:56:11.131388 2178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:56:11.131669 2178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_72ef5492c793427eb63e3ef64dafadde" } modify_external_catalogs: true
I20260620 02:56:11.132068 2177 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42142:
table { table_name: "default.Table_639b095f095048e8891596cc4922f715" } new_table_name: "default.Table_14dde7287c0b47318c45e526f722d42f" modify_external_catalogs: true
I20260620 02:56:11.136544 2239 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:56:11.136941 2171 consensus_peers.cc:487] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 -> Peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Couldn't send request to peer 7e68099b11fb4e71a63f9749ec9da6bf. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 02:56:11.136972 2239 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:56:11.137076 2239 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
I20260620 02:56:11.137897 2335 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Refusing update from remote peer 38d9721548804411b8e68a41e247d9a8: Log matching property violated. Preceding OpId in replica: term: 4 index: 81. Preceding OpId from leader: term: 6 index: 87. (index mismatch)
*** Check failure stack trace: ***
I20260620 02:56:11.138844 2396 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 80, Time since last communication: 0.000s
@ 0x7f200cbd19ad google::LogMessage::Fail() at ??:0
@ 0x7f200cbd488a google::LogMessage::SendToLog() at ??:0
@ 0x7f200cbd14de google::LogMessage::Flush() at ??:0
@ 0x7f200cbd16d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f202276fba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f202276e901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:56:11.162400 2406 mvcc.cc:205] Tried to move back new op lower bound from 7298761372990861312 to 7298761372607152128. Current Snapshot: MvccSnapshot[applied={T|T < 7298761372990861312 or (T in {7298761372990861312})}]
I20260620 02:56:11.162827 2402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d9721548804411b8e68a41e247d9a8. Latest consensus state: current_term: 6 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:11.163199 2402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:11.163172 2409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:11.163460 2409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f202277566c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f20227754e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f200f7fbeaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:56:11.179783 2409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "38d9721548804411b8e68a41e247d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:11.180042 2409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:11.180285 2182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 6acad10256014c42a04a87c7fbb0d68a
I20260620 02:56:11.180600 2183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 60d4ef253c6f4e5397187e78231b5503
I20260620 02:56:11.181639 2186 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Sending DeleteTablet for 3 replicas of tablet 0b621af903534b51b89d0bc0e5f555f8
I20260620 02:56:11.182971 2183 catalog_manager.cc:6565] ReplaceTablet: tablet 60d4ef253c6f4e5397187e78231b5503 deleted and replaced by tablet 6382ffd0db204f7099341201efa90f41
I20260620 02:56:11.184338 2186 catalog_manager.cc:6565] ReplaceTablet: tablet 0b621af903534b51b89d0bc0e5f555f8 deleted and replaced by tablet 135968a72258448d8726e91be3866267
I20260620 02:56:11.188123 2182 catalog_manager.cc:6565] ReplaceTablet: tablet 6acad10256014c42a04a87c7fbb0d68a deleted and replaced by tablet 13be5c3b9ae040c8881e0aff290927bb
@ 0x7f2012ad56db start_thread at ??:0
@ 0x7f200ba6b61f clone at ??:0
W20260620 02:56:11.361191 2418 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:11.183803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.0.97.2:45629)
0620 02:56:11.193426 (+ 9623us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:11.193436 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:11.193461 (+ 25us) server_negotiation.cc:407] Connection header received
0620 02:56:11.193547 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 02:56:11.193555 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 02:56:11.193657 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 02:56:11.193777 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 02:56:11.360916 (+167139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44982: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":9453,"thread_start_us":9302,"threads_started":1}
W20260620 02:56:11.361191 2420 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:11.184547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38560 (local address 127.0.97.3:44643)
0620 02:56:11.192408 (+ 7861us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:11.192418 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:11.192443 (+ 25us) server_negotiation.cc:407] Connection header received
0620 02:56:11.192528 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 02:56:11.192537 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 02:56:11.192641 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 02:56:11.192758 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 02:56:11.360916 (+168158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38560: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":7705,"thread_start_us":7566,"threads_started":1}
W20260620 02:56:11.361703 1067 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:11.361946 2417 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:11.182968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46530 (local address 127.0.97.1:40979)
0620 02:56:11.194424 (+ 11456us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:11.194433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:11.194454 (+ 21us) server_negotiation.cc:407] Connection header received
0620 02:56:11.194527 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 02:56:11.194530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 02:56:11.194585 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 02:56:11.194658 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 02:56:11.360925 (+166267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46530: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":11322,"thread_start_us":11191,"threads_started":1}
W20260620 02:56:11.362084 1206 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:11.362727 1328 connection.cc:535] client connection to 127.0.97.61:34445 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:11.363801 1328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.61:34445)
W20260620 02:56:11.364040 1328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.61:34445)
W20260620 02:56:11.364241 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.61:34445)
W20260620 02:56:11.364435 1328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.61:34445)
I20260620 02:56:11.536602 1042 heartbeater.cc:503] Master 127.0.97.61:34445 was elected leader, sending a full tablet report...
I20260620 02:56:11.665724 2409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:56:11.665900 2409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:11.666419 2409 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:56:11.668992 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:11.669215 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:11.669364 2307 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:56:11.669622 2409 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 02:56:12.377107 2436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:56:12.377422 2436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:12.379277 2436 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:56:12.380657 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:12.381357 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:12.381512 2307 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf
I20260620 02:56:12.381793 2436 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 02:56:12.425617 2385 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:12.425804 2385 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:12.426393 2385 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:12.427309 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:12.427464 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:12.427564 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:12.427789 2385 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:12.829097 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--webserver_interface=127.0.97.62
--webserver_port=38827
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 02:56:13.155112 2439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:13.155390 2439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:13.155495 2439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:13.162439 2439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:13.162528 2439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:13.162617 2439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:13.162719 2439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:13.171378 2439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=38827
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:13.172662 2439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:13.174598 2439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:13.186908 2444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:13.187094 2445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:13.187367 2447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:13.187867 2439 server_base.cc:1034] running on GCE node
I20260620 02:56:13.188619 2439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:13.190053 2439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:13.191403 2439 hybrid_clock.cc:648] HybridClock initialized: now 1781924173191280 us; error 53 us; skew 500 ppm
I20260620 02:56:13.192013 2439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:13.195196 2439 webserver.cc:460] Webserver started at http://127.0.97.62:38827/ using document root <none> and password file <none>
I20260620 02:56:13.195906 2439 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:13.196067 2439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:13.201381 2439 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260620 02:56:13.204413 2453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:13.205741 2439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 02:56:13.205940 2439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:56:13.206892 2439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:13.238108 2439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:13.238898 2439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:13.239145 2439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:13.258034 2439 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:46739
I20260620 02:56:13.258070 2504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:46739 every 8 connection(s)
I20260620 02:56:13.259490 2439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
I20260620 02:56:13.266007 2505 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:13.267459 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 2439
I20260620 02:56:13.269814 2505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap starting.
I20260620 02:56:13.279831 2508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:56:13.280022 2508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:13.280766 2508 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
W20260620 02:56:13.293202 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:13.296602 2505 log.cc:824] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:13.331440 1178 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:56:13.334872 1317 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:56:13.368961 2505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=56 ignored=0} mutations{seen=68 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 02:56:13.369604 2505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap complete.
I20260620 02:56:13.380791 2505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:13.382025 2505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Initialized, Role: FOLLOWER
I20260620 02:56:13.382695 2505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 5.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:13.383633 2514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.384048 2514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:13.384851 2505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:13.384898 2480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 7 candidate_status { last_received { term: 6 index: 90 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:56:13.385497 2480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f31390712542bf916d639cd0e4a435 in term 5.
I20260620 02:56:13.386098 2307 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:56:13.386462 2508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 02:56:13.386620 2508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 38d9721548804411b8e68a41e247d9a8)
I20260620 02:56:13.386732 2508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 6 FOLLOWER]: Advancing to term 7
I20260620 02:56:13.390161 2508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:13.390842 2508 leader_election.cc:288] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 election: Requested vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445)
I20260620 02:56:13.391500 2480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f31390712542bf916d639cd0e4a435" candidate_term: 7 candidate_status { last_received { term: 6 index: 90 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
I20260620 02:56:13.391758 2480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 5 FOLLOWER]: Advancing to term 7
W20260620 02:56:13.393955 2307 leader_election.cc:334] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:13.397259 2480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f31390712542bf916d639cd0e4a435 in term 7.
I20260620 02:56:13.398175 2307 leader_election.cc:302] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435; no voters: 38d9721548804411b8e68a41e247d9a8
I20260620 02:56:13.398648 2508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 02:56:13.400744 2508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [term 7 LEADER]: Becoming Leader. State: Replica: 88f31390712542bf916d639cd0e4a435, State: Running, Role: LEADER
I20260620 02:56:13.401229 2508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 6.90, Last appended by leader: 90, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:13.412691 2531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f31390712542bf916d639cd0e4a435. Latest consensus state: current_term: 7 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.413035 2531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:13.418573 2534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:56:13.419420 2528 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:13.419531 2528 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: loading cluster ID for follower catalog manager: success
I20260620 02:56:13.422083 2534 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:56:13.422964 2534 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:56:13.423359 2534 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:56:13.423775 2534 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:56:13.424154 2534 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:56:13.424266 2528 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: acquiring CA information for follower catalog manager: success
I20260620 02:56:13.424552 2534 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:56:13.424953 2534 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:56:13.425359 2534 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:56:13.425685 2534 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:56:13.415517 2439 master_runner.cc:186] Error getting master registration for 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111),
I20260620 02:56:13.426332 2439 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:13.426780 2534 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:56:13.427260 2534 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:56:13.427464 2528 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:13.427663 2534 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:56:13.428064 2534 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:56:13.428467 2534 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:56:13.431373 2534 tablet_loader.cc:96] loaded metadata for tablet 0de4191c5bd74289b7ea8528f02a794c (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:56:13.431772 2534 tablet_loader.cc:96] loaded metadata for tablet 10fd34892bed4c78801d349e4f332f9c (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:56:13.432047 2534 tablet_loader.cc:96] loaded metadata for tablet 135968a72258448d8726e91be3866267 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:56:13.432313 2534 tablet_loader.cc:96] loaded metadata for tablet 13be5c3b9ae040c8881e0aff290927bb (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:56:13.432853 2534 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:56:13.434509 2534 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:56:13.435040 2534 tablet_loader.cc:96] loaded metadata for tablet 6382ffd0db204f7099341201efa90f41 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:56:13.435979 2534 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:56:13.437386 2534 tablet_loader.cc:96] loaded metadata for tablet ae99f00924a84045b5f18f23a96421e9 (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:56:13.437968 2534 tablet_loader.cc:96] loaded metadata for tablet cc7f4ba88f254a26a63205fe13331249 (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:56:13.438524 2534 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:56:13.438884 2534 tablet_loader.cc:96] loaded metadata for tablet e017ff28be7c46de9808c7d0c469686b (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:56:13.439256 2534 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:56:13.439764 2534 tablet_loader.cc:96] loaded metadata for tablet f3788c34d60f4b8287dce9908e17dcb6 (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:56:13.440289 2534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:56:13.442193 2534 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:13.442296 2534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:56:13.444571 2534 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:56:13.446373 2534 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Loaded TSK: 0
I20260620 02:56:13.447491 2534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:56:13.449164 2534 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:56:13.450918 2534 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:56:13.519029 2324 master_service.cc:946] ReplaceTablet: received request to replace tablet ae99f00924a84045b5f18f23a96421e9 from {username='slave'} at 127.0.0.1:39404
I20260620 02:56:13.521111 2320 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:56:13.521497 2320 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:56:13.521905 2325 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_dc643ed381634c72bbee223a230c6049" } new_table_name: "default.Table_c87847f0b19240b3b5c151662f32d4a9" modify_external_catalogs: true
I20260620 02:56:13.522383 2322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:56:13.522684 2322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:56:13.523154 2323 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39404:
name: "default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:13.520484 2319 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_93f177252a6c4a49b1c2cd213cc0e1ba" } new_table_name: "default.Table_be09d676a02748338b4b22de5b701eb0" modify_external_catalogs: true
I20260620 02:56:13.522017 2321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39404:
table { table_name: "default.Table_bc27032cc2ca40b1a29b31593c811b0c" } new_table_name: "default.Table_ab662cd82b9b4c5389924ad4ff7846b7" modify_external_catalogs: true
I20260620 02:56:13.524078 2318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39404:
name: "default.Table_4de3fc606f0549218237315827ac3a45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:13.521461 2317 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39404:
name: "default.Table_bedc0a11a14744d3a493a3239abf429b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:13.523634 2316 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39404:
name: "default.Table_50de7b3586d54bcd96eaa04479c238c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 02:56:13.528759 2307 consensus_peers.cc:487] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 -> Peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Couldn't send request to peer 38d9721548804411b8e68a41e247d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 02:56:13.529359 2480 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Refusing update from remote peer 88f31390712542bf916d639cd0e4a435: Log matching property violated. Preceding OpId in replica: term: 5 index: 85. Preceding OpId from leader: term: 7 index: 92. (index mismatch)
I20260620 02:56:13.530242 2531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 85, Time since last communication: 0.000s
I20260620 02:56:13.530592 2378 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:56:13.531025 2378 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:56:13.531193 2378 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
*** Check failure stack trace: ***
@ 0x7fe21647e9ad google::LogMessage::Fail() at ??:0
@ 0x7fe21648188a google::LogMessage::SendToLog() at ??:0
@ 0x7fe21647e4de google::LogMessage::Flush() at ??:0
@ 0x7fe21647e6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe22c01cba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 02:56:13.550120 1041 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
@ 0x7fe22c01b901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fe22c02266c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fe22c0224e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 02:56:13.567526 2470 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:59625; Asking this server to re-register.
I20260620 02:56:13.568513 1041 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:13.568374 2514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f31390712542bf916d639cd0e4a435. Latest consensus state: current_term: 7 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.568655 2514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:13.570676 2470 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:13.571079 2544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.571502 2544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fe2190a8eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:56:13.572480 2531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.572744 2531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435 [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:13.573755 2324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88f31390712542bf916d639cd0e4a435: Sending DeleteTablet for 3 replicas of tablet ae99f00924a84045b5f18f23a96421e9
I20260620 02:56:13.573829 2544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "88f31390712542bf916d639cd0e4a435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:13.574043 2544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:13.575798 2324 catalog_manager.cc:6565] ReplaceTablet: tablet ae99f00924a84045b5f18f23a96421e9 deleted and replaced by tablet b045c1453bd246029d12b58ae0a2af3f
I20260620 02:56:13.577941 2324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39404:
name: "default.Table_ceb67d36056c496181ada59dce624540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fe21c3826db start_thread at ??:0
@ 0x7fe21531861f clone at ??:0
W20260620 02:56:13.764063 2551 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:13.576433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43586 (local address 127.0.97.3:44643)
0620 02:56:13.590749 (+ 14316us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:13.590757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:13.590779 (+ 22us) server_negotiation.cc:407] Connection header received
0620 02:56:13.590862 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 02:56:13.590868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 02:56:13.590955 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 02:56:13.591056 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 02:56:13.763658 (+172602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43586: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":14187,"thread_start_us":14814,"threads_started":1}
W20260620 02:56:13.764300 2554 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:13.581081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.0.97.2:45629)
0620 02:56:13.586285 (+ 5204us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:13.586294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:13.586321 (+ 27us) server_negotiation.cc:407] Connection header received
0620 02:56:13.586438 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 02:56:13.586446 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 02:56:13.586544 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 02:56:13.586658 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 02:56:13.763996 (+177338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46252: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":5047,"thread_start_us":4959,"threads_started":1}
W20260620 02:56:13.764451 2457 connection.cc:535] server connection from 127.0.0.1:45778 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:13.764902 2553 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:13.580890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47876 (local address 127.0.97.1:40979)
0620 02:56:13.587270 (+ 6380us) server_negotiation.cc:206] Beginning negotiation
0620 02:56:13.587282 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0620 02:56:13.764606 (+177324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47876: BlockingRecv error: recv got EOF from 127.0.0.1:47876 (error 108)
Metrics: {"server-negotiator.queue_time_us":6234,"thread_start_us":6115,"threads_started":1}
W20260620 02:56:13.765861 1329 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.60:33171)
W20260620 02:56:13.766422 1329 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:33171)
W20260620 02:56:13.767115 1329 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:33171)
W20260620 02:56:13.767352 1329 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.60:33171)
I20260620 02:56:13.836617 2470 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:34687; Asking this server to re-register.
I20260620 02:56:13.837330 1178 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:13.838703 2470 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:40855; Asking this server to re-register.
I20260620 02:56:13.839183 2469 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:13.839278 1317 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:13.840910 2469 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:14.077852 1040 heartbeater.cc:503] Master 127.0.97.60:33171 was elected leader, sending a full tablet report...
I20260620 02:56:14.086642 2561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:14.086845 2561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:14.088680 2561 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:14.089457 2456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:56:14.090669 2456 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:56:14.090854 2457 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:14.091035 2457 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:14.091374 2561 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:14.790313 2565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:14.790477 2565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:14.791252 2565 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:14.793449 2456 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:56:14.793659 2457 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:14.793829 2457 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:14.794112 2565 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:15.361382 2570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 88f31390712542bf916d639cd0e4a435)
I20260620 02:56:15.361624 2570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:15.363248 2570 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:15.365037 2457 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:15.365521 2456 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:15.365661 2456 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:15.365916 2570 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:15.567414 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu pid 2439
I20260620 02:56:15.580152 2500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 02:56:15.697096 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu with pid 2439
I20260620 02:56:15.828140 2578 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:15.828550 2578 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:15.829365 2578 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:15.830093 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:15.830271 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:15.830407 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:15.830632 2578 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:16.067174 2578 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:16.067420 2578 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:16.068106 2578 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:16.069056 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:16.069324 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:16.069455 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:16.069727 2578 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:16.556895 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--webserver_interface=127.0.97.62
--webserver_port=38827
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 02:56:16.894570 2580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:16.894842 2580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:16.894917 2580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:16.902184 2580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:16.902279 2580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:16.902320 2580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:16.902366 2580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:16.911381 2580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=38827
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:16.912566 2580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:16.914202 2580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:16.927291 2587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:16.927316 2586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:16.927425 2589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:16.927994 2580 server_base.cc:1034] running on GCE node
I20260620 02:56:16.928704 2580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:16.930068 2580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:16.931344 2580 hybrid_clock.cc:648] HybridClock initialized: now 1781924176931279 us; error 57 us; skew 500 ppm
I20260620 02:56:16.931706 2580 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:16.933946 2580 webserver.cc:460] Webserver started at http://127.0.97.62:38827/ using document root <none> and password file <none>
I20260620 02:56:16.934716 2580 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:16.934859 2580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:16.940647 2580 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260620 02:56:16.943636 2595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:16.945078 2580 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260620 02:56:16.945246 2580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
uuid: "7e68099b11fb4e71a63f9749ec9da6bf"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:56:16.946197 2580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:16.974244 2580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:16.975062 2580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:16.975364 2580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:16.994055 2580 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:46739
I20260620 02:56:16.994094 2646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:46739 every 8 connection(s)
I20260620 02:56:16.995489 2580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-0/data/info.pb
I20260620 02:56:16.996068 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 2580
I20260620 02:56:17.003679 2647 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:17.008179 2647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap starting.
I20260620 02:56:17.024365 2647 log.cc:824] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:17.095435 2647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=93 overwritten=0 applied=92 ignored=0} inserts{seen=61 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 02:56:17.096035 2647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Bootstrap complete.
I20260620 02:56:17.103657 2647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:17.106798 2647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Initialized, Role: FOLLOWER
I20260620 02:56:17.107489 2647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 92, Last appended: 7.93, Last appended by leader: 93, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:17.108253 2652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:17.108603 2652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:17.109308 2647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:17.134856 2666 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:17.134970 2666 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: loading cluster ID for follower catalog manager: success
I20260620 02:56:17.139707 2666 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: acquiring CA information for follower catalog manager: success
I20260620 02:56:17.144613 2666 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:17.149302 2580 master_runner.cc:186] Error getting master registration for 127.0.97.61:34445: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111),
I20260620 02:56:17.158527 2580 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:17.229907 1041 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:56:17.233791 2612 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:39731; Asking this server to re-register.
I20260620 02:56:17.234532 1041 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:17.236497 2612 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:17.364449 1317 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:56:17.366142 2612 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:60021; Asking this server to re-register.
I20260620 02:56:17.367519 1317 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:17.369215 2611 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:17.373157 1178 heartbeater.cc:347] Connected to a master server at 127.0.97.62:46739
I20260620 02:56:17.374488 2611 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:60915; Asking this server to re-register.
I20260620 02:56:17.375018 1178 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:17.376839 2611 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:17.564160 2652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:17.564532 2652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:17.566390 2652 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:17.567320 2598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:56:17.568962 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:17.569425 2598 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:17.569597 2598 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:17.569974 2652 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:18.163744 2676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:18.164008 2676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:18.164722 2676 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:18.167045 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:18.167529 2598 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:18.167649 2598 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:18.167955 2676 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:18.743909 2680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:18.744088 2680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:18.744701 2680 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:18.749958 2598 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
W20260620 02:56:18.750212 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:18.750315 2599 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:18.750525 2680 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:20.017583 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
/tmp/dist-test-taskvDWu0V/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--webserver_interface=127.0.97.61
--webserver_port=38883
--builtin_ntp_servers=127.0.97.20:39993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 02:56:20.311311 2687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:20.311542 2687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:20.312230 2687 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:20.315111 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:20.315387 2598 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445): Network error: Client connection negotiation failed: client connection to 127.0.97.61:34445: connect: Connection refused (error 111)
I20260620 02:56:20.315519 2598 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 38d9721548804411b8e68a41e247d9a8, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:20.315804 2687 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 02:56:20.346465 2686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 02:56:20.346753 2686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 02:56:20.346899 2686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 02:56:20.354048 2686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 02:56:20.354180 2686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 02:56:20.354267 2686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 02:56:20.354374 2686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 02:56:20.363341 2686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:39993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35101
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=38883
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 02:00:34 UTC on ccycloud.quasar-ycjack.root.comops.site
build id 4456918
ASAN enabled
I20260620 02:56:20.364588 2686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 02:56:20.366333 2686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 02:56:20.378360 2696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:20.378355 2695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 02:56:20.378361 2698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 02:56:20.379280 2686 server_base.cc:1034] running on GCE node
I20260620 02:56:20.379978 2686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 02:56:20.381299 2686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 02:56:20.382539 2686 hybrid_clock.cc:648] HybridClock initialized: now 1781924180382470 us; error 44 us; skew 500 ppm
I20260620 02:56:20.382902 2686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 02:56:20.385377 2686 webserver.cc:460] Webserver started at http://127.0.97.61:38883/ using document root <none> and password file <none>
I20260620 02:56:20.386070 2686 fs_manager.cc:359] Metadata directory not provided
I20260620 02:56:20.386207 2686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 02:56:20.392194 2686 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260620 02:56:20.395025 2704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 02:56:20.396399 2686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260620 02:56:20.396564 2686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
uuid: "38d9721548804411b8e68a41e247d9a8"
format_stamp: "Formatted at 2026-06-20 02:55:49 on dist-test-slave-w01b"
I20260620 02:56:20.397537 2686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 02:56:20.413832 2686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 02:56:20.414579 2686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 02:56:20.414799 2686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 02:56:20.432857 2686 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:34445
I20260620 02:56:20.432884 2755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:34445 every 8 connection(s)
I20260620 02:56:20.434230 2686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/master-1/data/info.pb
I20260620 02:56:20.435623 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvDWu0V/build/asan/bin/kudu as pid 2686
I20260620 02:56:20.441231 2756 sys_catalog.cc:263] Verifying existing consensus state
I20260620 02:56:20.445035 2756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap starting.
I20260620 02:56:20.463836 2756 log.cc:824] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Log is configured to *not* fsync() on all Append() calls
I20260620 02:56:20.532269 2756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=89 ignored=0} inserts{seen=59 ignored=0} mutations{seen=71 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 02:56:20.532852 2756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: Bootstrap complete.
I20260620 02:56:20.540199 2756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:20.543162 2756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d9721548804411b8e68a41e247d9a8, State: Initialized, Role: FOLLOWER
I20260620 02:56:20.543797 2756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 89, Last appended: 6.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:20.544562 2761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:20.544902 2761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:20.545583 2756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 02:56:20.571237 1042 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:20.571517 1042 heartbeater.cc:503] Master 127.0.97.61:34445 was elected leader, sending a full tablet report...
I20260620 02:56:20.578776 2721 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" instance_seqno: 1781924151350987) as {username='slave'} at 127.0.97.1:58511; Asking this server to re-register.
I20260620 02:56:20.579114 2775 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:20.581759 2775 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: loading cluster ID for follower catalog manager: success
I20260620 02:56:20.582614 1042 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:20.584772 2720 ts_manager.cc:194] Registered new tserver with Master: 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979)
I20260620 02:56:20.586553 2775 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: acquiring CA information for follower catalog manager: success
I20260620 02:56:20.588825 2775 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 02:56:20.603022 2686 master_runner.cc:186] Error getting master registration for 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111),
I20260620 02:56:20.609061 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:20.891161 1179 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:20.892992 2721 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" instance_seqno: 1781924151920066) as {username='slave'} at 127.0.97.2:33807; Asking this server to re-register.
I20260620 02:56:20.893535 1179 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:20.895004 2721 ts_manager.cc:194] Registered new tserver with Master: 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:20.898227 1318 heartbeater.cc:347] Connected to a master server at 127.0.97.61:34445
I20260620 02:56:20.900032 2721 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f967984189c40c8afe26a19f52b782e" instance_seqno: 1781924152459103) as {username='slave'} at 127.0.97.3:58181; Asking this server to re-register.
I20260620 02:56:20.900640 1318 heartbeater.cc:464] Registering TS with master...
I20260620 02:56:20.902252 2721 ts_manager.cc:194] Registered new tserver with Master: 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:21.024696 2761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:21.025048 2761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:21.026857 2761 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:21.027465 2622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 7 candidate_status { last_received { term: 6 index: 90 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
W20260620 02:56:21.027571 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:21.027964 2622 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38d9721548804411b8e68a41e247d9a8 in current term 7: Already voted for candidate 88f31390712542bf916d639cd0e4a435 in this term.
W20260620 02:56:21.028993 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:21.029300 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:21.029614 2761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 6 FOLLOWER]: Advancing to term 7
I20260620 02:56:21.032812 2761 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 02:56:21.571410 2785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:21.571650 2785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:21.572419 2785 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:21.572889 2622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38d9721548804411b8e68a41e247d9a8" candidate_term: 8 candidate_status { last_received { term: 6 index: 90 } } ignore_live_leader: false dest_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" is_pre_election: true
I20260620 02:56:21.573282 2622 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38d9721548804411b8e68a41e247d9a8 for term 8 because replica has last-logged OpId of term: 7 index: 93, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 90.
W20260620 02:56:21.574632 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:21.574813 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:21.575073 2785 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 02:56:21.903064 2791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:21.903249 2791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:21.903869 2791 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:21.906598 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:21.912256 2731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 93 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8" is_pre_election: true
I20260620 02:56:21.912782 2731 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 7.
I20260620 02:56:21.913326 2598 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 88f31390712542bf916d639cd0e4a435
I20260620 02:56:21.913658 2791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 02:56:21.913823 2791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:21.913954 2791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 7 FOLLOWER]: Advancing to term 8
I20260620 02:56:21.917368 2791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:21.917943 2791 leader_election.cc:288] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 election: Requested vote from peers 38d9721548804411b8e68a41e247d9a8 (127.0.97.61:34445), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
I20260620 02:56:21.918442 2731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 93 } } ignore_live_leader: false dest_uuid: "38d9721548804411b8e68a41e247d9a8"
I20260620 02:56:21.918648 2731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 7 FOLLOWER]: Advancing to term 8
W20260620 02:56:21.919315 2599 leader_election.cc:334] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:21.920861 2731 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e68099b11fb4e71a63f9749ec9da6bf in term 8.
I20260620 02:56:21.921223 2598 leader_election.cc:302] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8, 7e68099b11fb4e71a63f9749ec9da6bf; no voters: 88f31390712542bf916d639cd0e4a435
I20260620 02:56:21.921588 2791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 8 FOLLOWER]: Leader election won for term 8
I20260620 02:56:21.922045 2791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [term 8 LEADER]: Becoming Leader. State: Replica: 7e68099b11fb4e71a63f9749ec9da6bf, State: Running, Role: LEADER
I20260620 02:56:21.922648 2791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 7.93, Last appended by leader: 93, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:21.925637 2796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 8 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:21.925915 2796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
I20260620 02:56:22.166213 2580 master_runner.cc:186] Error getting master registration for 127.0.97.60:33171: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111),
I20260620 02:56:22.166509 2580 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:22.320227 2797 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:22.320497 2797 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.321502 2797 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:22.322022 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:22.322357 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:22.322448 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:22.322719 2797 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:22.331590 2731 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Refusing update from remote peer 7e68099b11fb4e71a63f9749ec9da6bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 90. Preceding OpId from leader: term: 8 index: 94. (index mismatch)
I20260620 02:56:22.332742 2796 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 89, Time since last communication: 0.000s
I20260620 02:56:22.338611 2803 mvcc.cc:205] Tried to move back new op lower bound from 7298761414758981632 to 7298761414257475584. Current Snapshot: MvccSnapshot[applied={T|T < 7298761414758981632 or (T in {7298761414758981632})}]
I20260620 02:56:22.338265 2805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:22.338970 2805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:22.339181 2801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e68099b11fb4e71a63f9749ec9da6bf. Latest consensus state: current_term: 8 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:22.339529 2801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:22.341029 2801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:22.341291 2801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 02:56:22.346269 2791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } } }
I20260620 02:56:22.346618 2791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf [sys.catalog]: This master's current role is: LEADER
W20260620 02:56:22.347747 2599 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf -> Peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Couldn't send request to peer 88f31390712542bf916d639cd0e4a435. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 02:56:22.442873 2799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 02:56:22.445832 2799 catalog_manager.cc:669] Loaded metadata for table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb]
I20260620 02:56:22.446575 2799 catalog_manager.cc:669] Loaded metadata for table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26]
I20260620 02:56:22.446944 2799 catalog_manager.cc:669] Loaded metadata for table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b]
I20260620 02:56:22.447328 2799 catalog_manager.cc:669] Loaded metadata for table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25]
I20260620 02:56:22.447654 2799 catalog_manager.cc:669] Loaded metadata for table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7]
I20260620 02:56:22.447986 2799 catalog_manager.cc:669] Loaded metadata for table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92]
I20260620 02:56:22.448307 2799 catalog_manager.cc:669] Loaded metadata for table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac]
I20260620 02:56:22.448637 2799 catalog_manager.cc:669] Loaded metadata for table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca]
I20260620 02:56:22.448953 2799 catalog_manager.cc:669] Loaded metadata for table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e]
I20260620 02:56:22.449524 2799 catalog_manager.cc:669] Loaded metadata for table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]
I20260620 02:56:22.450018 2799 catalog_manager.cc:669] Loaded metadata for table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]
I20260620 02:56:22.450414 2799 catalog_manager.cc:669] Loaded metadata for table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4]
I20260620 02:56:22.450743 2799 catalog_manager.cc:669] Loaded metadata for table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59]
I20260620 02:56:22.451139 2799 catalog_manager.cc:669] Loaded metadata for table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd]
I20260620 02:56:22.453125 2799 tablet_loader.cc:96] loaded metadata for tablet 0de4191c5bd74289b7ea8528f02a794c (table default.table_b944e69346c54bf09bf73e3939fdfaba [id=bac81f824f2f443690e94f79aed3baa4])
I20260620 02:56:22.453501 2799 tablet_loader.cc:96] loaded metadata for tablet 10fd34892bed4c78801d349e4f332f9c (table default.table_7f746bb2ed874273ae6e2d78b8379fab [id=89a1c1753e574b9ab886ef7e4d85b7ca])
I20260620 02:56:22.453783 2799 tablet_loader.cc:96] loaded metadata for tablet 135968a72258448d8726e91be3866267 (table default.table_dc643ed381634c72bbee223a230c6049 [id=be10ca4ee654441e8b1c7344b4068f59])
I20260620 02:56:22.454092 2799 tablet_loader.cc:96] loaded metadata for tablet 13be5c3b9ae040c8881e0aff290927bb (table default.table_ab16b64b7c0d434db981f8e6637ac171 [id=13a2ba530dfc41fe94221be9d6c9f5fb])
I20260620 02:56:22.454500 2799 tablet_loader.cc:96] loaded metadata for tablet 41ed74eaf3e24b03b3c03296b5970753 (table default.table_bc27032cc2ca40b1a29b31593c811b0c [id=5b5ee96572d24ba8938e982adfb70e92])
I20260620 02:56:22.455034 2799 tablet_loader.cc:96] loaded metadata for tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f])
I20260620 02:56:22.455426 2799 tablet_loader.cc:96] loaded metadata for tablet 6382ffd0db204f7099341201efa90f41 (table default.table_25240b69cc014c1d839a035fc97f6736 [id=495fb270c8e8439599d88c92043a5d25])
I20260620 02:56:22.456094 2799 tablet_loader.cc:96] loaded metadata for tablet 7ab1a97c7336431aa30d92695629aa88 (table default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14])
I20260620 02:56:22.457088 2799 tablet_loader.cc:96] loaded metadata for tablet b045c1453bd246029d12b58ae0a2af3f (table default.table_e5280ce916eb4d49906c6fe188573c59 [id=2a435f6efbd14152aaa03d84eddcda26])
I20260620 02:56:22.457573 2799 tablet_loader.cc:96] loaded metadata for tablet cc7f4ba88f254a26a63205fe13331249 (table default.table_273787c8398f498895aa38ce69969d53 [id=5189f07af77d45b39db30ebecba87aa7])
I20260620 02:56:22.457978 2799 tablet_loader.cc:96] loaded metadata for tablet ddb0e69b345a4b728949a6ff9cc3bd6f (table default.table_639b095f095048e8891596cc4922f715 [id=2af39a46098d4f3ea146586bba8b126b])
I20260620 02:56:22.458271 2799 tablet_loader.cc:96] loaded metadata for tablet e017ff28be7c46de9808c7d0c469686b (table default.table_72ef5492c793427eb63e3ef64dafadde [id=886354ecbd264237ab25474350ac8fac])
I20260620 02:56:22.458585 2799 tablet_loader.cc:96] loaded metadata for tablet e0f4099efdaf45289fe4f8bc21ad12b3 (table default.table_101af26dd3d043d7af79c17412564fa5 [id=fbb9982721e94b37a0bec7015035b5fd])
I20260620 02:56:22.459152 2799 tablet_loader.cc:96] loaded metadata for tablet f3788c34d60f4b8287dce9908e17dcb6 (table default.table_93f177252a6c4a49b1c2cd213cc0e1ba [id=9645a7c2573f41009f38c034668fb94e])
I20260620 02:56:22.459619 2799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 02:56:22.461125 2799 catalog_manager.cc:1259] Loaded cluster ID: cdda045480ea4abba468991f4697eb64
I20260620 02:56:22.461228 2799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 02:56:22.462713 2799 catalog_manager.cc:1504] Loading token signing keys...
I20260620 02:56:22.463965 2799 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Loaded TSK: 0
I20260620 02:56:22.464794 2799 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 02:56:22.465994 2799 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 02:56:22.467486 2799 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 22
I20260620 02:56:22.566093 2611 master_service.cc:946] ReplaceTablet: received request to replace tablet 60301752658446f8a9d7102897bb1fd3 from {username='slave'} at 127.0.0.1:45928
I20260620 02:56:22.566253 2612 master_service.cc:946] ReplaceTablet: received request to replace tablet 60d4ef253c6f4e5397187e78231b5503 from {username='slave'} at 127.0.0.1:45928
I20260620 02:56:22.567385 2610 master_service.cc:946] ReplaceTablet: received request to replace tablet 7ab1a97c7336431aa30d92695629aa88 from {username='slave'} at 127.0.0.1:45928
I20260620 02:56:22.567545 2606 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_c8a7ae199f32436d8fd09b4aad018b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:22.567704 2607 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_0c298c487d434f67b0a47a53292c42a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:22.568609 2612 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_4377b6cf14a84e548766cd36e6fc68e0" } new_table_name: "default.Table_59f7fde270354419ba554c2cdb50b188" modify_external_catalogs: true
I20260620 02:56:22.568542 2609 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_5fe1f2b14780430cb07cfd13f5ea91c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:22.569146 2605 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_1550ec9bf27b4226877f1c598bc58599"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:22.569983 2603 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_bc27032cc2ca40b1a29b31593c811b0c" } new_table_name: "default.Table_ab662cd82b9b4c5389924ad4ff7846b7" modify_external_catalogs: true
I20260620 02:56:22.571525 2604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:56:22.571763 2604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_273787c8398f498895aa38ce69969d53" } modify_external_catalogs: true
I20260620 02:56:22.572216 2608 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_0c6fd9cb1b4c46f1bf1d51a97c26196a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 02:56:22.575498 2665 catalog_manager.cc:2709] Deleting table default.table_1550ec9bf27b4226877f1c598bc58599 [id=7575317988be47d9944b5e96914ec04b] in response to Hive Metastore notification log event 23
W20260620 02:56:22.575896 2665 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 23 DROP_TABLE default.table_1550ec9bf27b4226877f1c598bc58599: Not found: the table does not exist: table_id: "7575317988be47d9944b5e96914ec04b" table_name: "default.table_1550ec9bf27b4226877f1c598bc58599"
F20260620 02:56:22.575992 2665 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 23): 23 DROP_TABLE default.table_273787c8398f498895aa38ce69969d53
*** Check failure stack trace: ***
@ 0x7f579e0679ad google::LogMessage::Fail() at ??:0
I20260620 02:56:22.578639 2611 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet 60301752658446f8a9d7102897bb1fd3
@ 0x7f579e06a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f579e0674de google::LogMessage::Flush() at ??:0
@ 0x7f579e0676d1 google::LogMessage::~LogMessage() at ??:0
I20260620 02:56:22.588207 2610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7e68099b11fb4e71a63f9749ec9da6bf: Sending DeleteTablet for 3 replicas of tablet 7ab1a97c7336431aa30d92695629aa88
I20260620 02:56:22.589107 2610 catalog_manager.cc:6565] ReplaceTablet: tablet 7ab1a97c7336431aa30d92695629aa88 deleted and replaced by tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6
I20260620 02:56:22.589542 2610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
I20260620 02:56:22.589808 2610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45928:
table { table_name: "default.Table_ab16b64b7c0d434db981f8e6637ac171" } modify_external_catalogs: true
@ 0x7f57b3c05ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 02:56:22.605940 2611 catalog_manager.cc:6565] ReplaceTablet: tablet 60301752658446f8a9d7102897bb1fd3 deleted and replaced by tablet fa4c71c948104dc39661b73a913f5791
I20260620 02:56:22.606390 2611 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45928:
name: "default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f57b3c04901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 02:56:22.611496 1250 tablet_service.cc:1467] Processing CreateTablet for tablet fa4c71c948104dc39661b73a913f5791 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.611747 1251 tablet_service.cc:1467] Processing CreateTablet for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.611949 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4c71c948104dc39661b73a913f5791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:22.612130 1249 tablet_service.cc:1514] Processing DeleteTablet for tablet 60301752658446f8a9d7102897bb1fd3 with delete_type TABLET_DATA_DELETED (replaced by tablet fa4c71c948104dc39661b73a913f5791) from {username='slave'} at 127.0.0.1:41260
I20260620 02:56:22.611492 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ab1a97c7336431aa30d92695629aa88 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6) from {username='slave'} at 127.0.0.1:41260
I20260620 02:56:22.612604 1251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f57b3c0b66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 02:56:22.618094 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 60301752658446f8a9d7102897bb1fd3 with delete_type TABLET_DATA_DELETED (replaced by tablet fa4c71c948104dc39661b73a913f5791) from {username='slave'} at 127.0.0.1:60424
I20260620 02:56:22.618201 1112 tablet_service.cc:1467] Processing CreateTablet for tablet fa4c71c948104dc39661b73a913f5791 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.618440 1110 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ab1a97c7336431aa30d92695629aa88 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6) from {username='slave'} at 127.0.0.1:60424
I20260620 02:56:22.618577 1112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4c71c948104dc39661b73a913f5791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:22.618793 1111 tablet_service.cc:1467] Processing CreateTablet for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.619117 1111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:22.626209 2820 tablet_replica.cc:330] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:56:22.626421 2820 raft_consensus.cc:2229] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:22.626629 2820 raft_consensus.cc:2258] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.627239 2820 ts_tablet_manager.cc:1905] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f57b3c0b4e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 02:56:22.629881 2819 tablet_replica.cc:330] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:56:22.630141 2819 raft_consensus.cc:2229] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:22.630383 2819 raft_consensus.cc:2258] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.631071 2819 ts_tablet_manager.cc:1905] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f57a0c91eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 02:56:22.637271 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 60301752658446f8a9d7102897bb1fd3 with delete_type TABLET_DATA_DELETED (replaced by tablet fa4c71c948104dc39661b73a913f5791) from {username='slave'} at 127.0.0.1:38490
I20260620 02:56:22.637382 2824 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:22.638005 972 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ab1a97c7336431aa30d92695629aa88 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6) from {username='slave'} at 127.0.0.1:38490
I20260620 02:56:22.638444 975 tablet_service.cc:1467] Processing CreateTablet for tablet fa4c71c948104dc39661b73a913f5791 (DEFAULT_TABLE table=default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.638813 975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4c71c948104dc39661b73a913f5791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:22.639315 2824 tablet_bootstrap.cc:654] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.640594 2822 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:56:22.641578 973 tablet_service.cc:1467] Processing CreateTablet for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6 (DEFAULT_TABLE table=default.table_4377b6cf14a84e548766cd36e6fc68e0 [id=b446a405122946cea1e869ec8944dc14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 02:56:22.641919 973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5dbbe3437bf4c9b8e1ad852b15d6fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 02:56:22.642356 2822 tablet_bootstrap.cc:654] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.643573 2820 ts_tablet_manager.cc:1918] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:22.643694 2820 log.cc:1196] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/60301752658446f8a9d7102897bb1fd3
@ 0x7f57a3f6b6db start_thread at ??:0
I20260620 02:56:22.644196 2820 ts_tablet_manager.cc:1939] T 60301752658446f8a9d7102897bb1fd3 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
@ 0x7f579cf0161f clone at ??:0
I20260620 02:56:22.645327 2820 tablet_replica.cc:330] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: stopping tablet replica
I20260620 02:56:22.645496 2599 catalog_manager.cc:4841] TS 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629): tablet 60301752658446f8a9d7102897bb1fd3 (table default.table_4ee5e7edf7f74bf8890817d8bc65111c [id=aa1da0ddebb44291ab3951e2a978a47f]) successfully deleted
I20260620 02:56:22.645563 2820 raft_consensus.cc:2229] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:22.645774 2820 raft_consensus.cc:2258] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.646931 2820 ts_tablet_manager.cc:1905] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:22.651093 2819 ts_tablet_manager.cc:1918] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:22.651252 2819 log.cc:1196] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/60301752658446f8a9d7102897bb1fd3
I20260620 02:56:22.651844 2819 ts_tablet_manager.cc:1939] T 60301752658446f8a9d7102897bb1fd3 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:56:22.652846 2819 tablet_replica.cc:330] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: stopping tablet replica
I20260620 02:56:22.653059 2819 raft_consensus.cc:2229] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:56:22.653354 2819 raft_consensus.cc:2258] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.653772 2820 ts_tablet_manager.cc:1918] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:56:22.653892 2820 log.cc:1196] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-1/wal/wals/7ab1a97c7336431aa30d92695629aa88
I20260620 02:56:22.653945 2819 ts_tablet_manager.cc:1905] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:22.654289 2820 ts_tablet_manager.cc:1939] T 7ab1a97c7336431aa30d92695629aa88 P 880a5420b43045f4bfcf690b20dac3de: Deleting consensus metadata
I20260620 02:56:22.658589 2825 tablet_replica.cc:330] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:56:22.658784 2825 raft_consensus.cc:2229] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 02:56:22.659137 2825 raft_consensus.cc:2258] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.659654 2825 ts_tablet_manager.cc:1905] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:22.659914 2819 ts_tablet_manager.cc:1918] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:56:22.660039 2819 log.cc:1196] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-2/wal/wals/7ab1a97c7336431aa30d92695629aa88
I20260620 02:56:22.660422 2819 ts_tablet_manager.cc:1939] T 7ab1a97c7336431aa30d92695629aa88 P 6f967984189c40c8afe26a19f52b782e: Deleting consensus metadata
I20260620 02:56:22.662395 2824 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:56:22.662528 2824 ts_tablet_manager.cc:1397] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.000s
I20260620 02:56:22.663341 2824 raft_consensus.cc:348] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.663640 2824 raft_consensus.cc:374] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.663728 2824 raft_consensus.cc:729] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.663990 2824 consensus_queue.cc:260] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.665843 2824 ts_tablet_manager.cc:1428] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 02:56:22.665998 2825 ts_tablet_manager.cc:1918] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 02:56:22.666103 2824 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de: Bootstrap starting.
I20260620 02:56:22.666110 2825 log.cc:1196] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/60301752658446f8a9d7102897bb1fd3
I20260620 02:56:22.666528 2825 ts_tablet_manager.cc:1939] T 60301752658446f8a9d7102897bb1fd3 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:56:22.667402 2825 tablet_replica.cc:330] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: stopping tablet replica
I20260620 02:56:22.667593 2825 raft_consensus.cc:2229] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 02:56:22.667768 2825 raft_consensus.cc:2258] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 02:56:22.668367 2825 ts_tablet_manager.cc:1905] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 02:56:22.668649 2824 tablet_bootstrap.cc:654] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.670205 2822 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:56:22.670331 2822 ts_tablet_manager.cc:1397] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.008s
I20260620 02:56:22.671725 2822 raft_consensus.cc:348] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.671988 2822 raft_consensus.cc:374] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.672077 2822 raft_consensus.cc:729] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.672338 2822 consensus_queue.cc:260] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.674358 2825 ts_tablet_manager.cc:1918] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 02:56:22.674531 2825 log.cc:1196] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Deleting WAL directory at /tmp/dist-test-taskvDWu0V/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781924129403882-388-0/minicluster-data/ts-0/wal/wals/7ab1a97c7336431aa30d92695629aa88
I20260620 02:56:22.674937 2825 ts_tablet_manager.cc:1939] T 7ab1a97c7336431aa30d92695629aa88 P 200c6cbcf0124308a686502d3ffd51bd: Deleting consensus metadata
I20260620 02:56:22.674363 2829 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:56:22.675949 2822 ts_tablet_manager.cc:1428] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260620 02:56:22.677572 2829 tablet_bootstrap.cc:654] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.679399 2822 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e: Bootstrap starting.
I20260620 02:56:22.687009 2822 tablet_bootstrap.cc:654] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.690850 2829 tablet_bootstrap.cc:492] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:56:22.690910 2822 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e: No bootstrap required, opened a new log
I20260620 02:56:22.690980 2829 ts_tablet_manager.cc:1397] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260620 02:56:22.691040 2822 ts_tablet_manager.cc:1397] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260620 02:56:22.691722 2822 raft_consensus.cc:348] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.691737 2829 raft_consensus.cc:348] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.691943 2829 raft_consensus.cc:374] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.691962 2822 raft_consensus.cc:374] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.692026 2829 raft_consensus.cc:729] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.692035 2822 raft_consensus.cc:729] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f967984189c40c8afe26a19f52b782e, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.692260 2822 consensus_queue.cc:260] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.692842 2822 ts_tablet_manager.cc:1428] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 02:56:22.693398 2829 consensus_queue.cc:260] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.693998 2829 ts_tablet_manager.cc:1428] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260620 02:56:22.694010 2824 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de: No bootstrap required, opened a new log
I20260620 02:56:22.694171 2824 ts_tablet_manager.cc:1397] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.009s
I20260620 02:56:22.694875 2824 raft_consensus.cc:348] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.695099 2824 raft_consensus.cc:374] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.695180 2824 raft_consensus.cc:729] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.695436 2824 consensus_queue.cc:260] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.695964 2824 ts_tablet_manager.cc:1428] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 02:56:22.696252 2829 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd: Bootstrap starting.
I20260620 02:56:22.697953 2829 tablet_bootstrap.cc:654] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd: Neither blocks nor log segments found. Creating new log.
I20260620 02:56:22.703675 2829 tablet_bootstrap.cc:492] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd: No bootstrap required, opened a new log
I20260620 02:56:22.703835 2829 ts_tablet_manager.cc:1397] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260620 02:56:22.704502 2829 raft_consensus.cc:348] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.704732 2829 raft_consensus.cc:374] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 02:56:22.704799 2829 raft_consensus.cc:729] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Initialized, Role: FOLLOWER
I20260620 02:56:22.705013 2829 consensus_queue.cc:260] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.705592 2829 ts_tablet_manager.cc:1428] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 02:56:22.805615 2797 raft_consensus.cc:482] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:22.805871 2797 raft_consensus.cc:504] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.806658 2797 leader_election.cc:288] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:22.807104 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4c71c948104dc39661b73a913f5791" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd" is_pre_election: true
I20260620 02:56:22.807341 994 raft_consensus.cc:2454] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:56:22.807324 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4c71c948104dc39661b73a913f5791" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:56:22.807578 1270 raft_consensus.cc:2454] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 0.
I20260620 02:56:22.807811 1065 leader_election.cc:302] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:22.808171 2797 raft_consensus.cc:2781] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:56:22.808274 2797 raft_consensus.cc:482] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:22.808357 2797 raft_consensus.cc:3037] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:22.811702 2797 raft_consensus.cc:504] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:22.813045 994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4c71c948104dc39661b73a913f5791" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200c6cbcf0124308a686502d3ffd51bd"
I20260620 02:56:22.813076 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4c71c948104dc39661b73a913f5791" candidate_uuid: "880a5420b43045f4bfcf690b20dac3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:56:22.813323 1270 raft_consensus.cc:3037] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:22.813316 994 raft_consensus.cc:3037] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:22.816166 1270 raft_consensus.cc:2454] T fa4c71c948104dc39661b73a913f5791 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:56:22.816179 994 raft_consensus.cc:2454] T fa4c71c948104dc39661b73a913f5791 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 880a5420b43045f4bfcf690b20dac3de in term 1.
I20260620 02:56:22.816422 2797 leader_election.cc:288] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Requested vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
I20260620 02:56:22.816810 1068 leader_election.cc:302] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f967984189c40c8afe26a19f52b782e, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:22.817175 2797 raft_consensus.cc:2781] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:56:22.817692 2797 raft_consensus.cc:686] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [term 1 LEADER]: Becoming Leader. State: Replica: 880a5420b43045f4bfcf690b20dac3de, State: Running, Role: LEADER
I20260620 02:56:22.817977 2797 consensus_queue.cc:237] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
W20260620 02:56:22.849179 929 connection.cc:535] server connection from 127.0.0.1:38490 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.849292 1206 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.849202 1066 connection.cc:535] server connection from 127.0.0.1:60424 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.849344 1067 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.849598 930 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.850085 1328 connection.cc:535] client connection to 127.0.97.62:46739 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.850685 1328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:46739)
W20260620 02:56:22.849171 1204 connection.cc:535] server connection from 127.0.0.1:41260 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 02:56:22.851327 1328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:46739)
W20260620 02:56:22.851547 1328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:46739)
W20260620 02:56:22.852074 1328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:46739)
W20260620 02:56:22.852476 2817 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:22.850712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.62:46739 (local address 127.0.97.1:46141)
0620 02:56:22.850956 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0620 02:56:22.850980 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0620 02:56:22.851085 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 02:56:22.852146 (+ 1061us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":142}
W20260620 02:56:22.852586 2810 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:22.850271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.62:46739 (local address 127.0.97.2:52141)
0620 02:56:22.850528 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0620 02:56:22.850548 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0620 02:56:22.850673 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 02:56:22.852314 (+ 1641us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":134}
W20260620 02:56:22.853392 2809 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 02:56:22.851429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.62:46739 (local address 127.0.97.3:33535)
0620 02:56:22.851640 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0620 02:56:22.851663 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0620 02:56:22.851772 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 02:56:22.852983 (+ 1211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":110}
I20260620 02:56:22.991472 388 master-stress-test.cc:578] Killing test thread 1/25
I20260620 02:56:23.057771 2823 raft_consensus.cc:482] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 02:56:23.058001 2823 raft_consensus.cc:504] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:23.059299 2823 leader_election.cc:288] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:23.059721 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5dbbe3437bf4c9b8e1ad852b15d6fd6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e" is_pre_election: true
I20260620 02:56:23.059748 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5dbbe3437bf4c9b8e1ad852b15d6fd6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de" is_pre_election: true
I20260620 02:56:23.059952 1270 raft_consensus.cc:2454] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:23.060014 1131 raft_consensus.cc:2454] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 0.
I20260620 02:56:23.060427 931 leader_election.cc:302] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e; no voters:
I20260620 02:56:23.060714 2823 raft_consensus.cc:2781] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 02:56:23.060833 2823 raft_consensus.cc:482] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 02:56:23.060920 2823 raft_consensus.cc:3037] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:23.063102 2823 raft_consensus.cc:504] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:23.063697 2823 leader_election.cc:288] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Requested vote from peers 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643), 880a5420b43045f4bfcf690b20dac3de (127.0.97.2:45629)
I20260620 02:56:23.064118 1270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5dbbe3437bf4c9b8e1ad852b15d6fd6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f967984189c40c8afe26a19f52b782e"
I20260620 02:56:23.064143 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5dbbe3437bf4c9b8e1ad852b15d6fd6" candidate_uuid: "200c6cbcf0124308a686502d3ffd51bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "880a5420b43045f4bfcf690b20dac3de"
I20260620 02:56:23.064316 1270 raft_consensus.cc:3037] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:23.064345 1131 raft_consensus.cc:3037] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 0 FOLLOWER]: Advancing to term 1
I20260620 02:56:23.066231 1131 raft_consensus.cc:2454] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:23.066591 931 leader_election.cc:302] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200c6cbcf0124308a686502d3ffd51bd, 880a5420b43045f4bfcf690b20dac3de; no voters:
I20260620 02:56:23.066704 1270 raft_consensus.cc:2454] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 6f967984189c40c8afe26a19f52b782e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 200c6cbcf0124308a686502d3ffd51bd in term 1.
I20260620 02:56:23.066856 2823 raft_consensus.cc:2781] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 02:56:23.067030 2823 raft_consensus.cc:686] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [term 1 LEADER]: Becoming Leader. State: Replica: 200c6cbcf0124308a686502d3ffd51bd, State: Running, Role: LEADER
I20260620 02:56:23.067334 2823 consensus_queue.cc:237] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:23.101387 2846 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:23.101719 2846 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:23.102427 2846 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:23.104353 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:23.104503 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:23.104657 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:23.104960 2846 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:23.656857 2797 consensus_queue.cc:1035] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:23.662829 2853 consensus_queue.cc:1035] T fa4c71c948104dc39661b73a913f5791 P 880a5420b43045f4bfcf690b20dac3de [LEADER]: Connected to new peer: Peer: permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:23.843886 2860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:23.844063 2860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:23.844563 2860 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:23.846933 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:23.847095 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:23.847247 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:23.847476 2860 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:24.082070 2579 consensus_queue.cc:1035] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:24.088651 2868 consensus_queue.cc:1035] T f5dbbe3437bf4c9b8e1ad852b15d6fd6 P 200c6cbcf0124308a686502d3ffd51bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 02:56:24.405567 2870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:24.405784 2870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:24.406536 2870 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:24.408450 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:24.408632 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:24.408772 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:24.409013 2870 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:25.039690 2879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:25.039878 2879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:25.040553 2879 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:25.043402 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:25.043707 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:25.043840 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:25.044158 2879 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:25.610443 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:25.610643 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:25.647013 2877 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:25.647192 2877 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:25.647953 2877 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:25.649097 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:25.649278 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:25.649482 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:25.649768 2877 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:25.751132 2891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:25.751448 2891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:25.752219 2891 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:25.754029 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:25.755738 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:25.755976 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:25.756297 2891 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:28.957365 2925 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:28.957561 2925 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:28.958287 2925 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:28.959363 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260620 02:56:28.960613 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:28.961047 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:28.961174 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:28.961503 2925 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:29.769073 2877 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:29.769268 2877 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:29.770175 2877 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:29.771027 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:29.771234 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:29.771333 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:29.771548 2877 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:30.612612 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:30.612823 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:32.738286 2877 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:32.738487 2877 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:32.739223 2877 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:32.740571 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:32.740788 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:32.740931 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:32.741197 2877 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:33.595003 2988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:33.595181 2988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:33.595788 2988 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:33.598162 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:33.598341 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:33.598438 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:33.598685 2988 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:35.614703 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:35.614941 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:38.605614 3035 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:38.605873 3035 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:38.606626 3035 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:38.607532 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:38.607803 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:38.607929 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:38.608202 3035 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:39.463285 3071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:39.463512 3071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:39.464155 3071 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:39.465224 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 02:56:39.466387 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:39.466620 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:39.466740 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:39.466964 3071 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:40.616290 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:40.616467 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:43.165800 3123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:43.166036 3123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:43.166745 3123 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:43.168946 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:43.169353 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:43.169533 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:43.169776 3123 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:43.752676 3133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:56:43.752853 3133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:56:43.753566 3133 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:56:43.756404 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:43.756593 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:56:43.756757 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:56:43.757055 3133 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:56:44.105127 3141 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:44.105379 3141 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:44.106048 3141 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:44.107110 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:44.107285 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:44.107378 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:44.107613 3141 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:44.953823 3152 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:44.954036 3152 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:56:44.954874 3152 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:44.955744 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:56:44.955925 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:56:44.956065 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:44.956359 3152 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:45.618172 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:45.618412 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:47.883126 3152 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:47.883388 3152 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:47.884073 3152 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:47.885003 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:47.885226 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:47.885460 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:47.885749 3152 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:56:50.620136 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:50.620406 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 02:56:53.181702 1317 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (64 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:53.325780 1040 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (86 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:56:53.325784 1041 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (66 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:56:53.423012 1178 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (65 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:56:55.622244 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:56:55.622495 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:56:59.399986 3316 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:56:59.400223 3316 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:56:59.400974 3316 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:56:59.402009 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:56:59.402343 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:56:59.402508 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:56:59.402858 3316 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:00.308864 3316 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:00.309059 3316 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:00.309927 3316 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:00.310973 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:00.311201 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:00.311291 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:00.311568 3316 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:00.627746 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:00.627949 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:02.902518 3370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:02.902786 3370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:02.903548 3370 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:02.904615 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260620 02:57:02.906687 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:02.907080 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:57:02.907259 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:02.907496 3370 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:57:05.629420 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:05.629603 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:10.631137 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:10.631350 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:10.859805 3469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:10.860031 3469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:10.860651 3469 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:10.861328 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:57:10.862694 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:10.862875 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:57:10.863030 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:10.863261 3469 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:57:15.632937 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:15.633144 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:19.107012 3573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:19.107242 3573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:19.107921 3573 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:19.108961 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:57:19.110292 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:57:19.110483 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:57:19.110639 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:19.110922 3573 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:57:19.133867 3482 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:19.134068 3482 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:19.134872 3482 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:19.135651 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:19.135819 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:19.135967 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:19.136246 3482 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:19.272444 3482 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:19.272614 3482 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:57:19.273332 3482 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:19.274151 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:57:19.274298 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:57:19.274438 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:19.274685 3482 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:20.634518 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:20.634709 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:22.980476 3625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:22.980710 3625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:22.981475 3625 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:22.983596 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:22.983850 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:57:22.983989 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:22.984261 3625 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:57:25.636242 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:25.636565 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:26.572731 3672 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:26.572919 3672 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:57:26.573632 3672 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:26.574606 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:57:26.574756 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:57:26.574916 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:26.575167 3672 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:30.638298 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:30.638533 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:31.869601 3701 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:31.869854 3701 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:31.870582 3701 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:31.871642 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:31.871865 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:31.872004 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:31.872249 3701 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:35.639957 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:35.640185 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:38.603899 3782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:38.604103 3782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:38.604936 3782 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:38.606040 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 02:57:38.607249 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:57:38.607529 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:57:38.607677 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:38.607906 3782 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:57:40.642179 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:40.642469 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:41.007582 3787 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:41.007845 3787 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:57:41.008749 3787 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:41.009676 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:57:41.009824 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:57:41.009994 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:41.010228 3787 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:45.644088 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:45.644269 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:46.188293 3867 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:46.188473 3867 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:46.189203 3867 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:46.190099 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:46.190225 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:46.190411 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:46.190673 3867 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:50.450062 3917 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:50.450274 3917 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:50.450978 3917 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:50.451894 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:50.452158 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:50.452251 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:50.452589 3917 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:50.648360 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:50.648547 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:52.776543 3963 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:57:52.776804 3963 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:57:52.777495 3963 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:57:52.778839 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:57:52.780478 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:52.780704 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:57:52.780831 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:57:52.781131 3963 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 02:57:53.358624 1316 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (204 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:53.517640 1040 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (206 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:57:53.633922 1178 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (185 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:57:55.650296 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:57:55.650535 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:57:57.027297 4019 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:57.027565 4019 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:57:57.029001 4019 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:57.029559 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:57:57.029924 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:57:57.030015 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:57.030313 4027 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:57:57.229864 4027 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:57:57.230141 4027 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:57:57.230876 4027 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:57:57.231621 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:57:57.231812 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:57:57.231918 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:57:57.232303 4027 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:00.651930 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:00.652099 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:02.945675 4080 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:02.945899 4080 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:58:02.946637 4080 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:02.947801 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:58:02.948019 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:58:02.948163 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:02.948501 4080 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:05.654320 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:05.654521 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:08.806416 4171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:58:08.806696 4171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:58:08.807574 4171 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:58:08.808732 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:58:08.810110 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:58:08.810336 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:58:08.810503 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:58:08.810770 4171 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:58:10.655889 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:10.656205 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:12.662689 4218 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:12.662950 4218 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:58:12.663774 4218 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:12.664764 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:58:12.664942 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:58:12.665038 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:12.665274 4218 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:13.060962 4227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:58:13.061228 4227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:58:13.061926 4227 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:58:13.067740 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:58:13.067977 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:58:13.068094 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:58:13.068379 4227 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:58:15.419850 4218 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:15.420059 4218 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:58:15.420781 4218 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:15.421691 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:58:15.422360 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:58:15.422531 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:15.422838 4218 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:15.657891 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:15.658151 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:20.588141 2710 maintenance_manager.cc:419] P 38d9721548804411b8e68a41e247d9a8: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033345
I20260620 02:58:20.647048 2709 maintenance_manager.cc:643] P 38d9721548804411b8e68a41e247d9a8: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.058s user 0.021s sys 0.009s Metrics: {"bytes_written":21722,"cfile_init":1,"dirs.queue_time_us":390,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":930,"drs_written":1,"lbm_read_time_us":136,"lbm_reads_lt_1ms":4,"lbm_write_time_us":765,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":54,"thread_start_us":473,"threads_started":2,"wal-append.queue_time_us":348}
I20260620 02:58:20.648391 2710 maintenance_manager.cc:419] P 38d9721548804411b8e68a41e247d9a8: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3709 bytes on disk
I20260620 02:58:20.649187 2709 maintenance_manager.cc:643] P 38d9721548804411b8e68a41e247d9a8: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":131,"lbm_reads_lt_1ms":4}
I20260620 02:58:20.659492 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:20.659718 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:23.299388 4350 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:23.299593 4350 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:58:23.300369 4350 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:23.301149 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:58:23.301353 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:58:23.301491 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:23.301784 4350 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:25.661055 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:25.661293 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:27.738863 4403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:58:27.739073 4403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:58:27.739769 4403 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:58:27.740947 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 02:58:27.742465 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:58:27.742780 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:58:27.743371 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:58:27.743744 4403 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:58:27.753921 4402 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:27.754073 4402 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:58:27.754844 4402 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:27.755642 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:58:27.755861 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:58:27.756013 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:27.756244 4402 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:30.662770 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:30.663013 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:33.401175 4490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:58:33.401440 4490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:58:33.402181 4490 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:58:33.403213 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:58:33.404433 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:58:33.404819 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:58:33.405051 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:58:33.405489 4490 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:58:35.664497 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:35.664700 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:39.487134 4538 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:39.487305 4538 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:58:39.488505 4538 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:39.489440 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:58:39.489730 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:58:39.489845 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:39.490105 4538 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:40.666247 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:40.666472 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:43.134188 4618 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:43.134438 4618 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:58:43.135231 4618 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:43.136240 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:58:43.136446 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:58:43.136561 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:43.136801 4618 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:45.667989 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:45.668205 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:47.762001 4686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:58:47.762209 4686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:58:47.762918 4686 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:58:47.763909 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:58:47.765141 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:58:47.765452 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:58:47.765568 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:58:47.765838 4686 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:58:49.986681 4721 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:49.986884 4721 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:58:49.987576 4721 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:49.988574 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:58:49.988806 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:58:49.988895 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:49.989107 4721 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:58:50.669936 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:50.670178 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 02:58:53.549697 1316 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (324 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:58:53.727736 1040 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (326 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:58:53.816725 1177 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (325 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:58:55.671716 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:58:55.672070 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:58:57.261826 4848 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:58:57.262030 4848 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:58:57.262705 4848 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:58:57.263532 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:58:57.263736 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:58:57.263870 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:58:57.264143 4848 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:00.673753 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:00.673965 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:02.302747 4935 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:02.302922 4935 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:02.303694 4935 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:02.304581 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:02.304708 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:02.304870 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:02.305117 4935 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:05.676015 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:05.676306 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:06.324991 5003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:59:06.325325 5003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:59:06.326188 5003 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:59:06.327474 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:59:06.328771 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:59:06.328903 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:59:06.329058 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:59:06.329339 5003 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:59:06.399508 4982 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:06.399667 4982 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:06.400372 4982 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:06.401444 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:06.401592 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:06.401822 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:06.402148 4982 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:07.050755 5017 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:07.051141 5017 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:59:07.051781 5017 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:07.052731 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:59:07.052946 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:59:07.053057 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:07.053325 5017 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:10.677903 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:10.678141 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:11.432057 5071 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:11.432268 5071 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:11.432849 5071 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:11.433818 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:11.434038 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:11.434175 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:11.434485 5071 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:13.170945 5122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:59:13.171164 5122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:59:13.171988 5122 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:59:13.173002 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:59:13.174428 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:59:13.174723 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:59:13.174832 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:59:13.175143 5122 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:59:15.017882 5150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:59:15.018138 5150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:59:15.018823 5150 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:59:15.020951 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:59:15.021189 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:59:15.021358 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:59:15.021647 5150 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:59:15.679620 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:15.679816 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:15.717273 5071 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:15.717476 5071 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:59:15.718098 5071 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:15.719096 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:59:15.719328 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:59:15.719480 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:15.719723 5071 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:20.681492 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:20.681705 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:22.757808 5274 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:22.758023 5274 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:59:22.758801 5274 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:22.759943 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:59:22.760107 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:59:22.760284 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:22.760634 5274 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:25.645826 5323 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:25.646011 5323 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:25.646864 5323 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:25.647895 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:25.648085 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:25.648273 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:25.648567 5323 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:25.683219 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:25.683570 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:30.045782 5369 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:30.046106 5369 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:30.047086 5369 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:30.048143 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:30.048380 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:30.048501 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:30.048816 5369 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:30.685828 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:30.686033 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:32.401190 5439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:59:32.401482 5439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:59:32.402456 5439 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:59:32.403512 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 02:59:32.404677 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:59:32.404819 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 02:59:32.404978 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:59:32.405315 5439 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:59:35.687676 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:35.687903 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:40.689303 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:40.689538 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:41.721642 5587 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:41.722007 5587 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:59:41.722960 5587 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:41.724108 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:59:41.724349 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:59:41.724568 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:41.724833 5587 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:44.104761 5587 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:44.105011 5587 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:44.105786 5587 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:44.106714 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:44.106925 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:44.107033 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:44.107264 5587 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:45.691305 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:45.691555 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:48.502575 5683 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:48.502784 5683 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:48.503799 5683 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:48.504855 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:48.513612 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:48.513801 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:48.514098 5683 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:50.598373 5723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 02:59:50.598568 5723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 02:59:50.599434 5723 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 02:59:50.600868 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 02:59:50.602599 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:59:50.602787 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:59:50.602936 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 02:59:50.603250 5723 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 02:59:50.692800 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:50.693051 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 02:59:51.956481 5743 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:51.956713 5743 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 02:59:51.957557 5743 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:51.958590 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 02:59:51.958782 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 02:59:51.959189 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:51.959672 5743 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 02:59:53.568068 5743 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 02:59:53.568293 5743 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 02:59:53.568946 5743 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 02:59:53.569875 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 02:59:53.570062 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 02:59:53.570186 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 02:59:53.570389 5743 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 02:59:53.751091 1316 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (444 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:59:53.932363 1041 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (426 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 02:59:53.932363 1040 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (446 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 02:59:54.033272 1177 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (445 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 02:59:55.694734 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 02:59:55.694983 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:00.699877 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:00.700117 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:02.803818 5916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:02.804093 5916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:02.804821 5916 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:02.806722 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 03:00:02.808439 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:00:02.808727 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:00:02.808915 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:02.809181 5916 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:00:05.703402 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:05.703732 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:05.944965 5901 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:05.945134 5901 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:00:05.946200 5901 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:05.947424 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:00:05.947633 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:00:05.947877 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:05.948309 5901 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:08.919468 5979 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:08.919682 5979 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:00:08.920492 5979 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:08.921603 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:00:08.921943 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:00:08.922086 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:08.922436 5979 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:10.705024 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:10.705279 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:13.204911 6081 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:13.205137 6081 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:00:13.206580 6081 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:13.206956 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:00:13.207422 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:00:13.207551 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:13.207814 6081 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:14.216820 6097 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:14.216980 6097 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:00:14.217433 6097 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:14.218252 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:00:14.218374 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:00:14.218458 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:14.218624 6097 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:15.706888 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:15.707136 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:16.084275 6130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:16.084509 6130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:16.085211 6130 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:16.085929 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 03:00:16.087208 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 03:00:16.087491 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 03:00:16.087641 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:16.087904 6130 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:00:20.708786 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:20.709041 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:23.004735 6213 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:23.004961 6213 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:00:23.005786 6213 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:23.006703 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:00:23.006870 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:00:23.007114 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:23.007396 6213 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:24.633883 6265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:24.634096 6265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:24.634780 6265 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:24.638131 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 03:00:24.639603 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:00:24.639762 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:00:24.639855 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:24.640039 6265 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:00:25.710875 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:25.711086 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:29.974227 6352 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:29.974383 6352 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:00:29.975057 6352 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:29.975951 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:00:29.976095 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:00:29.976166 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:29.976382 6352 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:30.712530 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:30.713140 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:34.331758 6412 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:34.331959 6412 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:00:34.332607 6412 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:34.333475 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:00:34.333606 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:00:34.333726 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:34.333937 6412 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:35.696259 6440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:35.696484 6440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:35.697222 6440 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:35.698344 2708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 03:00:35.699594 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:00:35.699746 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:00:35.699867 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:35.700095 6440 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:00:35.714169 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:35.714335 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:40.715867 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:40.716099 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:45.717556 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:45.717795 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:45.983047 6569 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:45.983201 6569 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:00:45.983925 6569 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:45.984804 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:00:45.984977 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:00:45.985075 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:45.985420 6569 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:48.787017 6637 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:48.787207 6637 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:00:48.787927 6637 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:48.788930 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:00:48.789075 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:00:48.789161 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:48.789350 6637 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:00:50.719265 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:50.719483 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:51.816133 6689 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:51.816320 6689 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:51.817185 6689 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:51.818225 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 03:00:51.819284 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:00:51.819470 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:00:51.819617 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:51.819859 6689 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:00:52.692986 6701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:00:52.693198 6701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:00:52.693879 6701 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:00:52.696163 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:00:52.696338 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:00:52.696452 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:00:52.696659 6701 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 03:00:53.947073 1317 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (544 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 03:00:54.132205 1041 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:46739 (546 consecutive failures): Network error: Failed to ping master at 127.0.97.62:46739: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 03:00:54.241899 1177 heartbeater.cc:644] Failed to heartbeat to 127.0.97.60:33171 (565 consecutive failures): Network error: Failed to ping master at 127.0.97.60:33171: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 03:00:55.720976 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:00:55.721206 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:00:56.552572 6637 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:00:56.552734 6637 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:00:56.553442 6637 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:00:56.554386 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:00:56.554714 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:00:56.554826 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:00:56.555049 6637 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:00.722579 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:01:00.722800 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:01:03.238632 6828 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:03.238837 6828 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:01:03.239792 6828 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:03.240805 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:01:03.241110 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:01:03.241334 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:03.241695 6828 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:05.724345 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:01:05.724601 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:01:05.818542 6878 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:05.818722 6878 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:01:05.819321 6878 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:05.820166 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:01:05.820282 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:01:05.820443 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:05.820677 6878 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:05.830921 6879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:01:05.831110 6879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:01:05.831805 6879 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:01:05.832504 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 03:01:05.833928 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 03:01:05.834190 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 03:01:05.834334 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:01:05.834605 6879 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:01:06.395982 6882 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:06.396173 6882 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:01:06.397050 6882 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:06.398183 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:01:06.398329 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:01:06.398469 1068 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:06.398702 6882 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:08.888561 6916 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:08.888731 6916 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:01:08.889555 6916 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:08.890396 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:01:08.890518 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:01:08.890676 1068 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:08.890909 6916 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:09.598940 6927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:01:09.599246 6927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:01:09.600076 6927 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:01:09.603232 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
W20260620 03:01:09.603440 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
I20260620 03:01:09.603570 2707 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:01:09.604234 6927 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:01:10.216437 6931 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:10.216609 6931 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:01:10.217142 6931 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:10.217940 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:01:10.218053 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:01:10.218197 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:10.218415 6931 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:10.726133 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:01:10.726320 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:01:15.728734 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:01:15.728976 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:01:16.571628 7041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e68099b11fb4e71a63f9749ec9da6bf)
I20260620 03:01:16.571864 7041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e68099b11fb4e71a63f9749ec9da6bf" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 46739 } } peers { permanent_uuid: "38d9721548804411b8e68a41e247d9a8" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 34445 } } peers { permanent_uuid: "88f31390712542bf916d639cd0e4a435" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 33171 } }
I20260620 03:01:16.572885 7041 leader_election.cc:288] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739), 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171)
W20260620 03:01:16.573894 2707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 03:01:16.575141 2707 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e68099b11fb4e71a63f9749ec9da6bf (127.0.97.62:46739): Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111)
W20260620 03:01:16.575423 2708 leader_election.cc:334] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 88f31390712542bf916d639cd0e4a435 (127.0.97.60:33171): Network error: Client connection negotiation failed: client connection to 127.0.97.60:33171: connect: Connection refused (error 111)
I20260620 03:01:16.575762 2708 leader_election.cc:302] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38d9721548804411b8e68a41e247d9a8; no voters: 7e68099b11fb4e71a63f9749ec9da6bf, 88f31390712542bf916d639cd0e4a435
I20260620 03:01:16.576112 7041 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 38d9721548804411b8e68a41e247d9a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 03:01:17.469241 7053 raft_consensus.cc:482] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:17.469482 7053 raft_consensus.cc:504] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } }
I20260620 03:01:17.470139 7053 leader_election.cc:288] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:17.470991 1065 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
W20260620 03:01:17.471092 1068 leader_election.cc:341] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 9986f946441b4544b6acc01f7990468e
I20260620 03:01:17.471175 1065 leader_election.cc:302] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:17.471423 7053 raft_consensus.cc:2726] T 9986f946441b4544b6acc01f7990468e P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:20.730641 2686 master_runner.cc:186] Error getting master registration for 127.0.97.62:46739: Network error: Client connection negotiation failed: client connection to 127.0.97.62:46739: connect: Connection refused (error 111),
I20260620 03:01:20.730834 2686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 03:01:22.442466 7096 raft_consensus.cc:482] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 200c6cbcf0124308a686502d3ffd51bd)
I20260620 03:01:22.442835 7096 raft_consensus.cc:504] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "200c6cbcf0124308a686502d3ffd51bd" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 40979 } } peers { permanent_uuid: "6f967984189c40c8afe26a19f52b782e" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 44643 } } peers { permanent_uuid: "880a5420b43045f4bfcf690b20dac3de" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 45629 } }
I20260620 03:01:22.443822 7096 leader_election.cc:288] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979), 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643)
W20260620 03:01:22.445538 1068 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f967984189c40c8afe26a19f52b782e (127.0.97.3:44643): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
W20260620 03:01:22.445704 1065 leader_election.cc:341] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 200c6cbcf0124308a686502d3ffd51bd (127.0.97.1:40979): Not found: Tablet not found: 895f9db9d57140fda82e39b4fe631aaf
I20260620 03:01:22.445879 1065 leader_election.cc:302] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 880a5420b43045f4bfcf690b20dac3de; no voters: 200c6cbcf0124308a686502d3ffd51bd, 6f967984189c40c8afe26a19f52b782e
I20260620 03:01:22.446158 7096 raft_consensus.cc:2726] T 895f9db9d57140fda82e39b4fe631aaf P 880a5420b43045f4bfcf690b20dac3de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 03:01:22.684013 2710 maintenance_manager.cc:419] P 38d9721548804411b8e68a41e247d9a8: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3709 bytes on disk
I20260620 03:01:22.689031 2709 maintenance_manager.cc:643] P 38d9721548804411b8e68a41e247d9a8: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.004s sys 0.000s Metrics: {"dirs.queue_time_us":369,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":98,"thread_start_us":486,"threads_started":2,"wal-append.queue_time_us":340}
W20260620 03:01:22.864792 1329 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
W20260620 03:01:22.865113 1329 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
W20260620 03:01:22.865201 1329 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
W20260620 03:01:22.865345 1329 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
F20260620 03:01:22.876209 1358 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
*** Aborted at 1781924482 (unix time) try "date -d @1781924482" if you are using GNU date ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] C*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 *** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000184) received by PID 388 (TID 0x7f12169e0700) from PID 388; stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884696 1355 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
@ 0x7f1226833a46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884696 1355 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885914 1352 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884696 1355 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885914 1352 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885972 1346 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884696 1355 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885914 1352 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885972 1346 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.886312 1349 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
F20260620 03:01:22.876449 1338 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5fe1f2b14780430cb07cfd13f5ea91c2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.877781 1351 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878049 1334 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4de3fc606f0549218237315827ac3a45 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878217 1359 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.878358 1336 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bedc0a11a14744d3a493a3239abf429b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879257 1345 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879647 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_50de7b3586d54bcd96eaa04479c238c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879673 1353 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879731 1337 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c298c487d434f67b0a47a53292c42a7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879910 1354 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.879998 1342 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceb67d36056c496181ada59dce624540 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.880896 1350 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881033 1348 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881218 1339 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3de1fcdcd454e1a87ab9a1ba88cdc9f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.881699 1335 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1550ec9bf27b4226877f1c598bc58599 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882915 1347 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.882965 1360 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884267 1344 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884361 1343 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c8a7ae199f32436d8fd09b4aad018b36 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.884696 1355 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885914 1352 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.885972 1346 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.886312 1349 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)F20260620 03:01:22.886444 1340 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0c6fd9cb1b4c46f1bf1d51a97c26196a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 769) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.97.62:46739,127.0.97.61:34445,127.0.97.60:33171, num_attempts: 1)
*** Check failure stack trace: ***
@ 0x7f122a975980 (unknown) at ??:0
@ 0x7f1223b61e87 gsignal at ??:0
@ 0x7f1223b637f1 abort at ??:0
@ 0x7f12268259ad google::LogMessage::Fail() at ??:0
@ 0x7f122682888a google::LogMessage::SendToLog() at ??:0
@ 0x7f12268254de google::LogMessage::Flush() at ??:0
@ 0x7f1226826a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x403d42 kudu::MasterStressTest::CreateTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:298
@ 0x444b44 std::__invoke_impl<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:73
@ 0x4449fd std::__invoke<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:95
@ 0x4449ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:244
@ 0x44496e std::thread::_Invoker<>::operator()() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:253
@ 0x4446a9 std::thread::_State_impl<>::_M_run() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:196
@ 0x7f122f2b1a4f execute_native_thread_routine at ??:0
@ 0x7f122a96a6db start_thread at ??:0
@ 0x7f1223c4461f clone at ??:0