Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260621 02:41:35.350266 388 test_util.cc:268] Using random seed: 1994436048
2026-06-21T02:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-21T02:41:35Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskLUPbWb/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskLUPbWb/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/security.properties
2026-06-21 02:41:42: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskLUPbWb/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskLUPbWb/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260621 02:41:50.333011 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--webserver_interface=127.0.97.62
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:41:50.685695 629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:50.686002 629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:50.686082 629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:50.693501 629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:41:50.693624 629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:50.693666 629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:41:50.693714 629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:41:50.703513 629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:50.704883 629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:50.706733 629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:41:50.719688 634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:50.719655 637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:50.719632 635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:50.720118 629 server_base.cc:1034] running on GCE node
I20260621 02:41:50.721258 629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:50.722832 629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:50.724104 629 hybrid_clock.cc:648] HybridClock initialized: now 1782009710724006 us; error 77 us; skew 500 ppm
I20260621 02:41:50.724499 629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:50.731487 629 webserver.cc:460] Webserver started at http://127.0.97.62:37371/ using document root <none> and password file <none>
I20260621 02:41:50.732287 629 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:50.732450 629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:50.732788 629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:50.735635 629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/instance:
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:41:50.736553 629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal/instance:
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:41:50.742602 629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260621 02:41:50.746176 643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:50.747542 629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260621 02:41:50.747742 629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:41:50.747952 629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:50.764467 629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:50.765479 629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:50.765815 629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:50.786958 629 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:44219
I20260621 02:41:50.786993 694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:44219 every 8 connection(s)
I20260621 02:41:50.788638 629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
I20260621 02:41:50.792497 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 629
I20260621 02:41:50.792693 695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:50.792788 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal/instance
I20260621 02:41:50.795325 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--webserver_interface=127.0.97.61
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260621 02:41:50.799206 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:50.818512 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } has no permanent_uuid. Determining permanent_uuid...
W20260621 02:41:50.819656 647 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:41:50.821218 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:41:50.870644 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } attempt: 1
W20260621 02:41:50.872984 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:41:50.941293 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } attempt: 2
W20260621 02:41:50.943346 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:41:51.034651 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } attempt: 3
W20260621 02:41:51.036593 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:41:51.138761 696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:51.139084 696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:51.139160 696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:51.147042 696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:41:51.147162 696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:51.147204 696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:41:51.147253 696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:41:51.156575 696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:51.157979 696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:51.159674 696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:41:51.171831 707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:51.171801 704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:51.171905 705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:51.178113 696 server_base.cc:1034] running on GCE node
I20260621 02:41:51.178972 696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:51.179844 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } attempt: 4
I20260621 02:41:51.180610 696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260621 02:41:51.181856 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:41:51.181903 696 hybrid_clock.cc:648] HybridClock initialized: now 1782009711181821 us; error 50 us; skew 500 ppm
I20260621 02:41:51.182271 696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:51.184736 696 webserver.cc:460] Webserver started at http://127.0.97.61:41917/ using document root <none> and password file <none>
I20260621 02:41:51.185540 696 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:51.186126 696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:51.186470 696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:51.189159 696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/instance:
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.190009 696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal/instance:
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.195024 696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260621 02:41:51.198313 713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:51.199822 696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260621 02:41:51.200009 696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.200173 696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:51.219328 696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:51.220189 696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:51.220896 696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:51.240351 696 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:35493
I20260621 02:41:51.240379 764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:35493 every 8 connection(s)
I20260621 02:41:51.241820 696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
I20260621 02:41:51.244333 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 696
I20260621 02:41:51.244506 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal/instance
I20260621 02:41:51.245653 765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:51.246037 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--webserver_interface=127.0.97.60
--webserver_port=0
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260621 02:41:51.252408 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:51.268540 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:51.280004 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } has no permanent_uuid. Determining permanent_uuid...
W20260621 02:41:51.281396 714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:41:51.283254 765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:41:51.332558 765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 1
W20260621 02:41:51.334545 765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:41:51.402837 765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 2
W20260621 02:41:51.405097 765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:41:51.481146 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } attempt: 5
I20260621 02:41:51.488376 695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } has no permanent_uuid. Determining permanent_uuid...
W20260621 02:41:51.490870 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:41:51.496340 765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 3
W20260621 02:41:51.498953 765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:41:51.542165 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 1
W20260621 02:41:51.544202 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:41:51.604460 766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:51.604918 766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:51.605052 766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260621 02:41:51.612460 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 2
W20260621 02:41:51.614557 695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:41:51.616151 766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:41:51.616282 766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:51.616366 766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:41:51.616458 766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:41:51.634806 766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:51.636183 766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:51.637997 766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260621 02:41:51.642262 765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 4
W20260621 02:41:51.644586 765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:41:51.649575 775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:51.649880 777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:51.649904 774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:51.650972 766 server_base.cc:1034] running on GCE node
I20260621 02:41:51.651800 766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:51.653306 766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:51.654584 766 hybrid_clock.cc:648] HybridClock initialized: now 1782009711654510 us; error 52 us; skew 500 ppm
I20260621 02:41:51.654912 766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:51.657266 766 webserver.cc:460] Webserver started at http://127.0.97.60:39369/ using document root <none> and password file <none>
I20260621 02:41:51.657984 766 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:51.658125 766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:51.658453 766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:51.661118 766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/instance:
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.662380 766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal/instance:
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.667443 766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260621 02:41:51.670928 783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:51.672282 766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260621 02:41:51.672497 766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:41:51.672712 766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:51.690639 766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:51.691524 766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:51.691829 766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:51.711905 766 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:39755
I20260621 02:41:51.711938 834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:39755 every 8 connection(s)
I20260621 02:41:51.713265 766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
I20260621 02:41:51.713805 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 766
I20260621 02:41:51.714001 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal/instance
I20260621 02:41:51.716924 835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:51.721211 695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 3
I20260621 02:41:51.724471 835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:51.750488 835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:51.756569 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap starting.
I20260621 02:41:51.759462 835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } has no permanent_uuid. Determining permanent_uuid...
I20260621 02:41:51.760603 695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:51.762987 695 log.cc:824] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:51.767109 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: No bootstrap required, opened a new log
I20260621 02:41:51.772336 835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap starting.
I20260621 02:41:51.776621 835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:51.776993 695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:51.777334 695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:51.777515 695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Initialized, Role: FOLLOWER
I20260621 02:41:51.777766 835 log.cc:824] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:51.778142 695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:51.781659 835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: No bootstrap required, opened a new log
I20260621 02:41:51.781891 844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:51.782236 844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:51.783195 695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:41:51.796726 835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:51.797107 835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:51.797267 835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Initialized, Role: FOLLOWER
I20260621 02:41:51.797955 835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:51.800261 835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:41:51.800426 856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:51.800995 856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
W20260621 02:41:51.807610 860 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260621 02:41:51.825464 860 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260621 02:41:51.824717 629 master_runner.cc:186] Error getting master registration for 127.0.97.61:35493: OK, instance_id { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" instance_seqno: 1782009711234990 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260621 02:41:51.842276 629 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:41:51.928634 876 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260621 02:41:51.928942 876 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260621 02:41:51.910492 766 master_runner.cc:186] Error getting master registration for 127.0.97.61:35493: OK, instance_id { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" instance_seqno: 1782009711234990 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260621 02:41:51.938776 766 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:41:51.943806 765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } attempt: 5
W20260621 02:41:51.944581 789 tablet.cc:2369] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260621 02:41:51.958248 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap starting.
I20260621 02:41:51.962569 765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:51.963639 765 log.cc:824] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:51.973320 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: No bootstrap required, opened a new log
I20260621 02:41:52.002249 765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.002837 765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:52.003000 765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Initialized, Role: FOLLOWER
I20260621 02:41:52.003891 765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.005590 879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.005981 879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:52.007087 765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: configured and running, proceeding with master startup.
W20260621 02:41:52.018682 649 tablet.cc:2369] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260621 02:41:52.049019 696 master_runner.cc:263] No leader master found from master 3391f089f71e447b9628bac16fe3443c
I20260621 02:41:52.049176 696 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:41:52.066123 894 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260621 02:41:52.066403 894 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260621 02:41:52.067165 856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:52.067452 856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.068974 856 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
I20260621 02:41:52.069830 740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:41:52.069943 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:41:52.070459 670 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 0.
I20260621 02:41:52.070429 740 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 0.
I20260621 02:41:52.071548 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters:
I20260621 02:41:52.072304 856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:52.072469 856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:52.072579 856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:52.075875 856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.077188 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9"
I20260621 02:41:52.077448 670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:52.081615 740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c"
I20260621 02:41:52.081866 740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:52.084306 670 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 1.
I20260621 02:41:52.084649 856 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 1 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
I20260621 02:41:52.084908 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599; no voters:
I20260621 02:41:52.090121 740 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 1.
I20260621 02:41:52.093436 856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:52.102396 856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 LEADER]: Becoming Leader. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Running, Role: LEADER
I20260621 02:41:52.103137 856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.116130 896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.116518 896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:52.124919 898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:41:52.127149 898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:41:52.143318 740 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Refusing update from remote peer 5d142d25b86d4ad7935e806b7ebe8599: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:52.145372 896 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:52.152869 670 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Refusing update from remote peer 5d142d25b86d4ad7935e806b7ebe8599: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:52.153838 896 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:52.181028 844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.181386 844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:52.185883 899 mvcc.cc:205] Tried to move back new op lower bound from 7299111780926955520 to 7299111780781088768. Current Snapshot: MvccSnapshot[applied={T|T < 7299111780926955520}]
I20260621 02:41:52.193908 856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.194294 856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:52.196313 898 catalog_manager.cc:1347] Generated new cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:41:52.196424 898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:41:52.207168 844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.207511 844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:52.211687 879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.212009 879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:52.214653 896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.214910 896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:52.217856 900 mvcc.cc:205] Tried to move back new op lower bound from 7299111780926955520 to 7299111780781088768. Current Snapshot: MvccSnapshot[applied={T|T < 7299111780926955520}]
I20260621 02:41:52.230077 879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:52.230370 879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:52.246909 898 catalog_manager.cc:1370] Generated new certificate authority record
I20260621 02:41:52.250522 898 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:41:52.284762 898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Generated new TSK 0
I20260621 02:41:52.289985 898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:41:52.291452 898 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:41:52.292588 898 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260621 02:41:52.323933 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.1:0
--local_ip_for_outbound_sockets=127.0.97.1
--webserver_interface=127.0.97.1
--webserver_port=0
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260621 02:41:52.756423 908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:52.756780 908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:52.756964 908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:52.764688 908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:52.764922 908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.1
I20260621 02:41:52.775058 908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.97.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.1
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:52.776556 908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:52.778898 908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260621 02:41:52.783849 912 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:52.784032 912 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:52.785193 912 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:52.785945 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:41:52.786648 669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:41:52.787499 717 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:52.788276 912 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260621 02:41:52.795364 915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:52.795382 914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:52.795653 917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:52.796626 908 server_base.cc:1034] running on GCE node
I20260621 02:41:52.797240 908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:52.798305 908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:52.799546 908 hybrid_clock.cc:648] HybridClock initialized: now 1782009712799487 us; error 42 us; skew 500 ppm
I20260621 02:41:52.799885 908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:52.802927 908 webserver.cc:460] Webserver started at http://127.0.97.1:36491/ using document root <none> and password file <none>
I20260621 02:41:52.803705 908 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:52.803833 908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:52.804174 908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:52.806893 908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data/instance:
uuid: "35b23c9f06314e4abf6d8aff8989e73e"
format_stamp: "Formatted at 2026-06-21 02:41:52 on dist-test-slave-zz3r"
I20260621 02:41:52.807693 908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/instance:
uuid: "35b23c9f06314e4abf6d8aff8989e73e"
format_stamp: "Formatted at 2026-06-21 02:41:52 on dist-test-slave-zz3r"
I20260621 02:41:52.812948 908 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260621 02:41:52.816550 923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:52.818181 908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260621 02:41:52.818377 908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal
uuid: "35b23c9f06314e4abf6d8aff8989e73e"
format_stamp: "Formatted at 2026-06-21 02:41:52 on dist-test-slave-zz3r"
I20260621 02:41:52.818599 908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:52.827687 860 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:41:52.827781 860 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: loading cluster ID for follower catalog manager: success
I20260621 02:41:52.831027 860 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: acquiring CA information for follower catalog manager: success
I20260621 02:41:52.833180 860 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:41:52.836584 908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:52.837495 908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:52.837749 908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:52.838711 908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260621 02:41:52.840154 908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 02:41:52.840232 908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:52.840315 908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260621 02:41:52.840359 908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:52.883858 908 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.1:46793
I20260621 02:41:52.883858 1035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.1:46793 every 8 connection(s)
I20260621 02:41:52.885826 908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/data/info.pb
I20260621 02:41:52.888167 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 908
I20260621 02:41:52.888365 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/instance
I20260621 02:41:52.899376 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.2:0
--local_ip_for_outbound_sockets=127.0.97.2
--webserver_interface=127.0.97.2
--webserver_port=0
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260621 02:41:52.928762 1036 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:41:52.929194 1036 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:52.930275 1036 heartbeater.cc:511] Master 127.0.97.60:39755 requested a full tablet report, sending...
I20260621 02:41:52.932673 800 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:52.934500 800 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.1:36081
I20260621 02:41:52.939400 1037 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:52.939538 1037 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:52.939910 1037 heartbeater.cc:511] Master 127.0.97.62:44219 requested a full tablet report, sending...
I20260621 02:41:52.942173 660 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:52.943708 1038 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:41:52.943861 1038 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:52.944145 1038 heartbeater.cc:511] Master 127.0.97.61:35493 requested a full tablet report, sending...
I20260621 02:41:52.945876 730 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:53.068305 894 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:41:53.068449 894 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: loading cluster ID for follower catalog manager: success
I20260621 02:41:53.070881 894 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: acquiring CA information for follower catalog manager: success
I20260621 02:41:53.072508 894 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:41:53.272606 1050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:53.272845 1050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:53.274425 1050 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:53.275007 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:41:53.275017 740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:41:53.275799 644 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9; no voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:53.276201 1050 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260621 02:41:53.277987 1046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:53.278246 1046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:53.278335 1046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:53.285887 1046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:53.286494 1046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.2
I20260621 02:41:53.295758 1046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.97.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.2
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:53.297035 1046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:53.298820 1046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:41:53.312866 1053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:53.312894 1055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:53.312837 1052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:53.313879 1046 server_base.cc:1034] running on GCE node
I20260621 02:41:53.314550 1046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:53.315527 1046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:53.316761 1046 hybrid_clock.cc:648] HybridClock initialized: now 1782009713316676 us; error 58 us; skew 500 ppm
I20260621 02:41:53.317076 1046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:53.319536 1046 webserver.cc:460] Webserver started at http://127.0.97.2:42083/ using document root <none> and password file <none>
I20260621 02:41:53.320240 1046 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:53.320341 1046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:53.320577 1046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:53.323343 1046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data/instance:
uuid: "6f52030a7bb641f883dba1ffbd912dba"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.324059 1046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/instance:
uuid: "6f52030a7bb641f883dba1ffbd912dba"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.329300 1046 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260621 02:41:53.332674 1061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.334518 1046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260621 02:41:53.334736 1046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal
uuid: "6f52030a7bb641f883dba1ffbd912dba"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.335011 1046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:53.351280 1046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:53.352186 1046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:53.352519 1046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:53.353547 1046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260621 02:41:53.355085 1046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 02:41:53.355193 1046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.355336 1046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260621 02:41:53.355409 1046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.392724 1046 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.2:42873
I20260621 02:41:53.392741 1173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.2:42873 every 8 connection(s)
I20260621 02:41:53.394629 1046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/data/info.pb
I20260621 02:41:53.402634 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 1046
I20260621 02:41:53.402834 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/instance
I20260621 02:41:53.410679 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.97.3:0
--local_ip_for_outbound_sockets=127.0.97.3
--webserver_interface=127.0.97.3
--webserver_port=0
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260621 02:41:53.415079 1175 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:53.415398 1175 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.415793 1174 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:41:53.416016 1174 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.416518 1174 heartbeater.cc:511] Master 127.0.97.60:39755 requested a full tablet report, sending...
I20260621 02:41:53.416553 1175 heartbeater.cc:511] Master 127.0.97.62:44219 requested a full tablet report, sending...
I20260621 02:41:53.417618 1176 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:41:53.417768 1176 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.418162 1176 heartbeater.cc:511] Master 127.0.97.61:35493 requested a full tablet report, sending...
I20260621 02:41:53.418162 800 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:53.419003 800 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.2:48795
I20260621 02:41:53.419763 660 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:53.420862 730 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:53.438373 1036 heartbeater.cc:503] Master 127.0.97.60:39755 was elected leader, sending a full tablet report...
W20260621 02:41:53.775184 1181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:53.775679 1181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:53.775945 1181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:53.783977 1181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:53.784233 1181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.97.3
I20260621 02:41:53.799103 1181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.97.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.97.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.97.3
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:53.800781 1181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:53.803013 1181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:41:53.817951 1189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:53.817957 1187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:41:53.818759 1186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:53.819128 1181 server_base.cc:1034] running on GCE node
I20260621 02:41:53.819873 1181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:53.820943 1181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:53.822244 1181 hybrid_clock.cc:648] HybridClock initialized: now 1782009713822160 us; error 50 us; skew 500 ppm
I20260621 02:41:53.822585 1181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:53.825271 1181 webserver.cc:460] Webserver started at http://127.0.97.3:36823/ using document root <none> and password file <none>
I20260621 02:41:53.826028 1181 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:53.826179 1181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:53.826488 1181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 02:41:53.829207 1181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data/instance:
uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.830086 1181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/instance:
uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.835978 1181 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260621 02:41:53.839694 1195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.841295 1181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260621 02:41:53.841509 1181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal
uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
format_stamp: "Formatted at 2026-06-21 02:41:53 on dist-test-slave-zz3r"
I20260621 02:41:53.841693 1181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:53.855676 1181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:53.856526 1181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:53.856781 1181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:53.857787 1181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260621 02:41:53.859401 1181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 02:41:53.859473 1181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.859565 1181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260621 02:41:53.859608 1181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:53.898923 1181 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.3:36259
I20260621 02:41:53.898955 1307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.3:36259 every 8 connection(s)
I20260621 02:41:53.900249 1181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/data/info.pb
I20260621 02:41:53.904103 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 1181
I20260621 02:41:53.904325 388 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/instance
I20260621 02:41:53.921754 1310 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:41:53.921823 1309 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:53.922123 1310 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.922132 1309 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.922822 1174 heartbeater.cc:503] Master 127.0.97.60:39755 was elected leader, sending a full tablet report...
I20260621 02:41:53.923374 1309 heartbeater.cc:511] Master 127.0.97.62:44219 requested a full tablet report, sending...
I20260621 02:41:53.923400 1310 heartbeater.cc:511] Master 127.0.97.61:35493 requested a full tablet report, sending...
I20260621 02:41:53.923714 1308 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:41:53.923842 1308 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:53.924274 1308 heartbeater.cc:511] Master 127.0.97.60:39755 requested a full tablet report, sending...
I20260621 02:41:53.925220 660 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:53.925467 800 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:53.925702 730 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:53.926417 800 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.97.3:47833
I20260621 02:41:53.932551 388 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260621 02:41:53.965858 799 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_f8dfd6e6d9ff452eb1a8f384a50144d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.966081 798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_d92b84136868428790cb79925c3f1a33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.966302 795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_01693932aef84215b8b138fc1298be91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.966940 796 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_8ff1127b12c8401785fa7302af1a87d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.967386 794 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_3a8f206132a04b65a848c29145dfc1a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.968269 797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_377281571f164709ac6324086e74e1a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.969558 793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_d1ef4b80062944b2b46fb4b28a26a746"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.970772 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_db696663f6f14d8cb1c0aee6f43c48a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.971441 791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_73d184c634e44e4fa7308cc8ce9305fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:53.974191 800 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_6edd16d2d48f4b57a8f4f99ec6043589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260621 02:41:53.976074 795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_01693932aef84215b8b138fc1298be91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:53.976191 799 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f8dfd6e6d9ff452eb1a8f384a50144d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:53.977916 796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8ff1127b12c8401785fa7302af1a87d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:54.004870 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu pid 629
I20260621 02:41:54.006283 690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260621 02:41:54.187032 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu with pid 629
I20260621 02:41:54.203385 1355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:54.205089 1355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:54.209681 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:41:54.210520 1355 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:41:54.222996 717 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:41:54.233949 717 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:41:54.234138 717 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:54.234522 1355 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260621 02:41:54.429155 1308 heartbeater.cc:503] Master 127.0.97.60:39755 was elected leader, sending a full tablet report...
W20260621 02:41:54.435252 1309 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:41:54.440011 787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:41:54.441571 1175 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:41:54.443758 787 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 -> Peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Couldn't send request to peer 09161df32dff4fa18f1926765ea191d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260621 02:41:54.461995 1037 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:41:54.528614 799 catalog_manager.cc:2148] created HMS catalog entry for table [id=00bcbcf024244266942dbcf393b15aaf]
W20260621 02:41:54.532501 794 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3a8f206132a04b65a848c29145dfc1a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:54.532581 792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_db696663f6f14d8cb1c0aee6f43c48a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:54.532737 800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6edd16d2d48f4b57a8f4f99ec6043589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:54.532976 791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_73d184c634e44e4fa7308cc8ce9305fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:54.533751 797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_377281571f164709ac6324086e74e1a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:54.534324 793 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d1ef4b80062944b2b46fb4b28a26a746 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:54.572865 799 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_f8dfd6e6d9ff452eb1a8f384a50144d4" } new_table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" modify_external_catalogs: true
I20260621 02:41:54.577685 796 catalog_manager.cc:2148] created HMS catalog entry for table [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:41:54.603508 796 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_8ff1127b12c8401785fa7302af1a87d9" } new_table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" modify_external_catalogs: true
I20260621 02:41:54.619335 1242 tablet_service.cc:1467] Processing CreateTablet for tablet efbc3adb80704c6d8726167312ab1866 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.620319 1243 tablet_service.cc:1467] Processing CreateTablet for tablet 2744c12c288144ccb6e00446fd53aeae (DEFAULT_TABLE table=default.table_f8dfd6e6d9ff452eb1a8f384a50144d4 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.621470 1243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2744c12c288144ccb6e00446fd53aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.625924 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efbc3adb80704c6d8726167312ab1866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.626124 971 tablet_service.cc:1467] Processing CreateTablet for tablet 2744c12c288144ccb6e00446fd53aeae (DEFAULT_TABLE table=default.table_f8dfd6e6d9ff452eb1a8f384a50144d4 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.627552 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2744c12c288144ccb6e00446fd53aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.627770 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 2744c12c288144ccb6e00446fd53aeae (DEFAULT_TABLE table=default.table_f8dfd6e6d9ff452eb1a8f384a50144d4 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.629112 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2744c12c288144ccb6e00446fd53aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.629578 970 tablet_service.cc:1467] Processing CreateTablet for tablet efbc3adb80704c6d8726167312ab1866 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.630056 970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efbc3adb80704c6d8726167312ab1866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.631340 1108 tablet_service.cc:1467] Processing CreateTablet for tablet efbc3adb80704c6d8726167312ab1866 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.631793 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efbc3adb80704c6d8726167312ab1866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.640905 795 catalog_manager.cc:2148] created HMS catalog entry for table [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:41:54.650781 795 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_01693932aef84215b8b138fc1298be91" } new_table_name: "default.Table_65a5205e941c44c5bdc59e0846793cb3" modify_external_catalogs: true
I20260621 02:41:54.654918 1376 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.655587 971 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.656066 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2f231e0731496d9ea9e6180617bcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.657172 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.657716 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2f231e0731496d9ea9e6180617bcb1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260621 02:41:54.660924 798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d92b84136868428790cb79925c3f1a33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:54.663146 1377 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.663614 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.664176 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2f231e0731496d9ea9e6180617bcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.667098 1377 tablet_bootstrap.cc:654] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.667713 1376 tablet_bootstrap.cc:654] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.668464 1377 log.cc:824] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:54.668967 1376 log.cc:824] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:54.676561 1376 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.676955 1376 ts_tablet_manager.cc:1397] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20260621 02:41:54.678298 1377 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.678718 1377 ts_tablet_manager.cc:1397] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.010s
I20260621 02:41:54.680598 1380 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.685184 1380 tablet_bootstrap.cc:654] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.686725 1380 log.cc:824] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:54.689901 1377 raft_consensus.cc:348] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.690919 1377 raft_consensus.cc:374] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.691107 1377 raft_consensus.cc:729] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.691978 1377 consensus_queue.cc:260] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.692947 1380 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.693315 1380 ts_tablet_manager.cc:1397] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260621 02:41:54.695736 1376 raft_consensus.cc:348] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.696359 1376 raft_consensus.cc:374] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.696497 1376 raft_consensus.cc:729] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.697448 1376 consensus_queue.cc:260] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.700955 1377 ts_tablet_manager.cc:1428] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.022s user 0.007s sys 0.011s
I20260621 02:41:54.706146 1377 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.706594 1376 ts_tablet_manager.cc:1428] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.030s user 0.015s sys 0.005s
I20260621 02:41:54.708325 1377 tablet_bootstrap.cc:654] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.711226 1376 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.712847 1376 tablet_bootstrap.cc:654] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.715461 1380 raft_consensus.cc:348] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.715982 1380 raft_consensus.cc:374] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.716086 1380 raft_consensus.cc:729] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.716893 1380 consensus_queue.cc:260] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.722963 1380 ts_tablet_manager.cc:1428] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.029s user 0.017s sys 0.000s
I20260621 02:41:54.723798 1377 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.723793 1376 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.723985 1376 ts_tablet_manager.cc:1397] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260621 02:41:54.724015 1377 ts_tablet_manager.cc:1397] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20260621 02:41:54.725034 1376 raft_consensus.cc:348] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.725034 1377 raft_consensus.cc:348] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.725273 1376 raft_consensus.cc:374] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.725391 1376 raft_consensus.cc:729] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.725430 1377 raft_consensus.cc:374] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.725616 1377 raft_consensus.cc:729] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.725664 1376 consensus_queue.cc:260] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.727718 1376 ts_tablet_manager.cc:1428] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260621 02:41:54.728485 1377 consensus_queue.cc:260] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.728796 1376 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.731086 1377 ts_tablet_manager.cc:1428] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260621 02:41:54.733019 1377 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.733700 1376 tablet_bootstrap.cc:654] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.733721 1380 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.735647 1380 tablet_bootstrap.cc:654] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.737239 1377 tablet_bootstrap.cc:654] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.741776 1376 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.741969 1376 ts_tablet_manager.cc:1397] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.001s
I20260621 02:41:54.742898 1376 raft_consensus.cc:348] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.743166 1376 raft_consensus.cc:374] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.743256 1376 raft_consensus.cc:729] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.743561 1376 consensus_queue.cc:260] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.743975 1380 tablet_bootstrap.cc:492] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.744151 1380 ts_tablet_manager.cc:1397] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260621 02:41:54.745214 1380 raft_consensus.cc:348] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.745464 1380 raft_consensus.cc:374] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.745563 1380 raft_consensus.cc:729] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.745888 1380 consensus_queue.cc:260] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.748332 1380 ts_tablet_manager.cc:1428] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260621 02:41:54.747964 1376 ts_tablet_manager.cc:1428] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260621 02:41:54.749485 1377 tablet_bootstrap.cc:492] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.749719 1377 ts_tablet_manager.cc:1397] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260621 02:41:54.750670 1380 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.750814 1377 raft_consensus.cc:348] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.751121 1377 raft_consensus.cc:374] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.751238 1377 raft_consensus.cc:729] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.751618 1377 consensus_queue.cc:260] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.753217 1380 tablet_bootstrap.cc:654] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.753474 1377 ts_tablet_manager.cc:1428] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260621 02:41:54.761651 1380 tablet_bootstrap.cc:492] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.761873 1380 ts_tablet_manager.cc:1397] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260621 02:41:54.762516 1382 raft_consensus.cc:482] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:54.762665 1380 raft_consensus.cc:348] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.762923 1380 raft_consensus.cc:374] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.762809 1382 raft_consensus.cc:504] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.762992 1380 raft_consensus.cc:729] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.763247 1380 consensus_queue.cc:260] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.764823 1382 leader_election.cc:288] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:54.765111 1380 ts_tablet_manager.cc:1428] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260621 02:41:54.771023 794 catalog_manager.cc:2148] created HMS catalog entry for table [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:41:54.775930 1382 raft_consensus.cc:482] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:54.775822 991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efbc3adb80704c6d8726167312ab1866" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:54.776125 1382 raft_consensus.cc:504] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.776424 991 raft_consensus.cc:2454] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:54.776732 1382 leader_election.cc:288] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:54.777347 991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2744c12c288144ccb6e00446fd53aeae" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:54.777578 991 raft_consensus.cc:2454] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:54.777493 1196 leader_election.cc:302] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:54.778106 1382 raft_consensus.cc:2781] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:54.778231 1382 raft_consensus.cc:482] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:54.778343 1382 raft_consensus.cc:3037] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:54.779542 1196 leader_election.cc:302] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:54.780254 1392 raft_consensus.cc:2781] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:54.780380 1392 raft_consensus.cc:482] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:54.780514 1392 raft_consensus.cc:3037] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:54.783620 1392 raft_consensus.cc:504] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.785043 991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2744c12c288144ccb6e00446fd53aeae" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:54.785284 991 raft_consensus.cc:3037] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:54.786765 1382 raft_consensus.cc:504] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.787846 990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efbc3adb80704c6d8726167312ab1866" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:54.788105 990 raft_consensus.cc:3037] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:54.788295 794 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b2f231e0731496d9ea9e6180617bcb1 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:54.788532 991 raft_consensus.cc:2454] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:54.788792 1392 leader_election.cc:288] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:54.789291 1382 leader_election.cc:288] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:54.789306 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 3dac6c7a546048d6ae29186f789ca188 (DEFAULT_TABLE table=default.table_3a8f206132a04b65a848c29145dfc1a9 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.789783 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dac6c7a546048d6ae29186f789ca188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.790864 990 raft_consensus.cc:2454] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:54.794036 1129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efbc3adb80704c6d8726167312ab1866" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:54.794342 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2744c12c288144ccb6e00446fd53aeae" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:54.794704 1129 raft_consensus.cc:2454] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:54.795126 971 tablet_service.cc:1467] Processing CreateTablet for tablet 3dac6c7a546048d6ae29186f789ca188 (DEFAULT_TABLE table=default.table_3a8f206132a04b65a848c29145dfc1a9 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.795245 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2744c12c288144ccb6e00446fd53aeae" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:54.795562 971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dac6c7a546048d6ae29186f789ca188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.795912 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efbc3adb80704c6d8726167312ab1866" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:54.796120 1126 raft_consensus.cc:3037] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:54.796247 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 3dac6c7a546048d6ae29186f789ca188 (DEFAULT_TABLE table=default.table_3a8f206132a04b65a848c29145dfc1a9 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.796660 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dac6c7a546048d6ae29186f789ca188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.799234 1126 raft_consensus.cc:2454] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:54.794708 1128 raft_consensus.cc:2454] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:54.801646 1198 leader_election.cc:302] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:54.802219 1382 raft_consensus.cc:2781] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:54.802424 1382 raft_consensus.cc:686] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:54.803013 1382 consensus_queue.cc:237] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.804347 1196 leader_election.cc:302] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters: 6f52030a7bb641f883dba1ffbd912dba
I20260621 02:41:54.805521 1392 raft_consensus.cc:2781] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:54.805675 1392 raft_consensus.cc:686] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:54.805909 1392 consensus_queue.cc:237] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:54.814178 1376 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.815948 1376 tablet_bootstrap.cc:654] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.819631 800 catalog_manager.cc:2148] created HMS catalog entry for table [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:41:54.820354 794 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 7b2f231e0731496d9ea9e6180617bcb1
I20260621 02:41:54.825901 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2540f7a8633748fdb8c43f8156e99ccf) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:54.833041 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b2f231e0731496d9ea9e6180617bcb1 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:54.837464 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b2f231e0731496d9ea9e6180617bcb1 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:54.840708 794 catalog_manager.cc:6565] ReplaceTablet: tablet 7b2f231e0731496d9ea9e6180617bcb1 deleted and replaced by tablet 2540f7a8633748fdb8c43f8156e99ccf
I20260621 02:41:54.841667 1397 tablet_replica.cc:330] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:54.841964 1243 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2540f7a8633748fdb8c43f8156e99ccf) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:54.842733 794 master_service.cc:946] ReplaceTablet: received request to replace tablet efbc3adb80704c6d8726167312ab1866 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:54.840488 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b2f231e0731496d9ea9e6180617bcb1 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:54.847437 1380 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.848328 800 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_7ef13b7647da48208cd992f8af548202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:54.849134 1380 tablet_bootstrap.cc:654] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.850898 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2540f7a8633748fdb8c43f8156e99ccf) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:54.846418 1377 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.856892 1397 raft_consensus.cc:2229] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:54.857596 970 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc0581f165c4a46a59516c65f820f19 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.858068 970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc0581f165c4a46a59516c65f820f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.858147 1397 raft_consensus.cc:2258] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.858588 1377 tablet_bootstrap.cc:654] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.859247 969 tablet_service.cc:1467] Processing CreateTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.859848 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2540f7a8633748fdb8c43f8156e99ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.859915 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.860316 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2540f7a8633748fdb8c43f8156e99ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.862291 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc0581f165c4a46a59516c65f820f19 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.863140 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc0581f165c4a46a59516c65f820f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.867429 1397 ts_tablet_manager.cc:1905] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.867444 1243 tablet_service.cc:1467] Processing CreateTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf (DEFAULT_TABLE table=default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.867990 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc0581f165c4a46a59516c65f820f19 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.868844 794 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet efbc3adb80704c6d8726167312ab1866
I20260621 02:41:54.869689 969 tablet_service.cc:1514] Processing DeleteTablet for tablet efbc3adb80704c6d8726167312ab1866 with delete_type TABLET_DATA_DELETED (replaced by tablet 0603aaa2e9b94ea48c859c08018055e5) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:54.845620 1398 tablet_replica.cc:330] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:54.870980 1241 tablet_service.cc:1514] Processing DeleteTablet for tablet efbc3adb80704c6d8726167312ab1866 with delete_type TABLET_DATA_DELETED (replaced by tablet 0603aaa2e9b94ea48c859c08018055e5) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:54.871254 1398 raft_consensus.cc:2229] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:54.871999 794 catalog_manager.cc:6565] ReplaceTablet: tablet efbc3adb80704c6d8726167312ab1866 deleted and replaced by tablet 0603aaa2e9b94ea48c859c08018055e5
I20260621 02:41:54.871512 1377 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.872786 1377 ts_tablet_manager.cc:1397] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20260621 02:41:54.873659 1377 raft_consensus.cc:348] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.873935 1377 raft_consensus.cc:374] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.874032 1377 raft_consensus.cc:729] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.874261 1377 consensus_queue.cc:260] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.874794 1377 ts_tablet_manager.cc:1428] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260621 02:41:54.875233 1398 raft_consensus.cc:2258] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.877705 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet efbc3adb80704c6d8726167312ab1866 with delete_type TABLET_DATA_DELETED (replaced by tablet 0603aaa2e9b94ea48c859c08018055e5) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:54.882499 969 tablet_service.cc:1467] Processing CreateTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.882961 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0603aaa2e9b94ea48c859c08018055e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.883301 1243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2540f7a8633748fdb8c43f8156e99ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.885136 1398 ts_tablet_manager.cc:1905] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.886181 1241 tablet_service.cc:1467] Processing CreateTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.877318 794 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_3a8f206132a04b65a848c29145dfc1a9" } new_table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" modify_external_catalogs: true
I20260621 02:41:54.890453 1241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0603aaa2e9b94ea48c859c08018055e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:54.893575 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 (DEFAULT_TABLE table=default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:54.894070 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0603aaa2e9b94ea48c859c08018055e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260621 02:41:54.901945 1043 tablet.cc:2369] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260621 02:41:54.903721 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc0581f165c4a46a59516c65f820f19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260621 02:41:54.904058 1177 tablet.cc:2369] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260621 02:41:54.905699 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--webserver_interface=127.0.97.62
--webserver_port=37371
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:41:54.909499 1311 tablet.cc:2369] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260621 02:41:54.917712 1377 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.918897 1400 tablet_replica.cc:330] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:54.919438 1400 raft_consensus.cc:2229] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:54.919603 1397 ts_tablet_manager.cc:1918] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:54.919795 1397 log.cc:1196] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/7b2f231e0731496d9ea9e6180617bcb1
I20260621 02:41:54.919961 1400 raft_consensus.cc:2258] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.920157 1377 tablet_bootstrap.cc:654] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.920280 1397 ts_tablet_manager.cc:1939] T 7b2f231e0731496d9ea9e6180617bcb1 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
W20260621 02:41:54.921931 1196 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.1:46793, user_credentials={real_user=slave}} blocked reactor thread for 117586us
I20260621 02:41:54.922283 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 7b2f231e0731496d9ea9e6180617bcb1 (table default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:54.925624 1377 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.925836 1377 ts_tablet_manager.cc:1397] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260621 02:41:54.926249 1397 tablet_replica.cc:330] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:54.926818 1397 raft_consensus.cc:2229] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:54.926750 1377 raft_consensus.cc:348] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.927004 1377 raft_consensus.cc:374] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.927096 1377 raft_consensus.cc:729] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.927353 1377 consensus_queue.cc:260] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.927939 1397 raft_consensus.cc:2258] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.927961 1377 ts_tablet_manager.cc:1428] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:54.930297 1400 ts_tablet_manager.cc:1905] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.931475 1397 ts_tablet_manager.cc:1905] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.935237 1377 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.937775 1377 tablet_bootstrap.cc:654] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.939988 1397 ts_tablet_manager.cc:1918] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:54.940258 1397 log.cc:1196] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/efbc3adb80704c6d8726167312ab1866
I20260621 02:41:54.940088 1380 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.940603 1380 ts_tablet_manager.cc:1397] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.012s
I20260621 02:41:54.941097 1376 tablet_bootstrap.cc:492] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.941244 1376 ts_tablet_manager.cc:1397] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.127s user 0.014s sys 0.022s
I20260621 02:41:54.941542 1380 raft_consensus.cc:348] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.941804 1380 raft_consensus.cc:374] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.941893 1380 raft_consensus.cc:729] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.942104 1376 raft_consensus.cc:348] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.942175 1380 consensus_queue.cc:260] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.942334 1376 raft_consensus.cc:374] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.942422 1376 raft_consensus.cc:729] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.942770 1380 ts_tablet_manager.cc:1428] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:54.942631 1376 consensus_queue.cc:260] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:54.943223 1376 ts_tablet_manager.cc:1428] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260621 02:41:54.944919 1398 ts_tablet_manager.cc:1918] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:54.945091 1398 log.cc:1196] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/7b2f231e0731496d9ea9e6180617bcb1
I20260621 02:41:54.945556 1376 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.947281 1376 tablet_bootstrap.cc:654] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.948539 1380 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.950713 1398 ts_tablet_manager.cc:1939] T 7b2f231e0731496d9ea9e6180617bcb1 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:54.952051 1380 tablet_bootstrap.cc:654] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.953337 1397 ts_tablet_manager.cc:1939] T efbc3adb80704c6d8726167312ab1866 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:54.954450 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet efbc3adb80704c6d8726167312ab1866 (table default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:54.955408 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 7b2f231e0731496d9ea9e6180617bcb1 (table default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:54.958544 1376 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.958843 1376 ts_tablet_manager.cc:1397] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260621 02:41:54.959676 1376 raft_consensus.cc:348] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.960001 1376 raft_consensus.cc:374] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.960134 1376 raft_consensus.cc:729] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.960309 1398 tablet_replica.cc:330] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:54.960539 1398 raft_consensus.cc:2229] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:54.960527 1376 consensus_queue.cc:260] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.960965 1398 pending_rounds.cc:62] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Trying to abort 1 pending ops.
I20260621 02:41:54.961177 1377 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.961128 1398 pending_rounds.cc:68] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299111791837990912 op_type: NO_OP noop_request { }
I20260621 02:41:54.961339 1377 ts_tablet_manager.cc:1397] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.000s
I20260621 02:41:54.961436 1398 raft_consensus.cc:2866] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260621 02:41:54.961606 1398 raft_consensus.cc:2258] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.962152 1377 raft_consensus.cc:348] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.962389 1377 raft_consensus.cc:374] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.962488 1377 raft_consensus.cc:729] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.962865 1376 ts_tablet_manager.cc:1428] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260621 02:41:54.962733 1377 consensus_queue.cc:260] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.963296 1377 ts_tablet_manager.cc:1428] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260621 02:41:54.963482 1376 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:54.965159 1376 tablet_bootstrap.cc:654] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.966109 1380 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.966359 1380 ts_tablet_manager.cc:1397] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260621 02:41:54.967281 1380 raft_consensus.cc:348] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.967612 1380 raft_consensus.cc:374] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.967716 1380 raft_consensus.cc:729] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.968035 1380 consensus_queue.cc:260] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.969718 1377 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:54.970374 1380 ts_tablet_manager.cc:1428] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260621 02:41:54.970883 1380 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.971565 1377 tablet_bootstrap.cc:654] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.972699 1380 tablet_bootstrap.cc:654] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.975023 1400 ts_tablet_manager.cc:1918] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:54.975222 1400 log.cc:1196] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/7b2f231e0731496d9ea9e6180617bcb1
I20260621 02:41:54.975883 1400 ts_tablet_manager.cc:1939] T 7b2f231e0731496d9ea9e6180617bcb1 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:54.978165 1400 tablet_replica.cc:330] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:54.978309 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 7b2f231e0731496d9ea9e6180617bcb1 (table default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:54.978406 1400 raft_consensus.cc:2229] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:54.978585 1400 raft_consensus.cc:2258] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:54.979408 1400 ts_tablet_manager.cc:1905] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.980353 1398 ts_tablet_manager.cc:1905] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:54.986471 1400 ts_tablet_manager.cc:1918] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:54.986690 1400 log.cc:1196] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/efbc3adb80704c6d8726167312ab1866
I20260621 02:41:54.987088 1400 ts_tablet_manager.cc:1939] T efbc3adb80704c6d8726167312ab1866 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:54.987323 1377 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:54.987519 1377 ts_tablet_manager.cc:1397] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260621 02:41:54.988435 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet efbc3adb80704c6d8726167312ab1866 (table default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:54.988631 1377 raft_consensus.cc:348] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.988946 1377 raft_consensus.cc:374] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.989044 1377 raft_consensus.cc:729] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.989286 1380 tablet_bootstrap.cc:492] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.989511 1380 ts_tablet_manager.cc:1397] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.003s
I20260621 02:41:54.989378 1377 consensus_queue.cc:260] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.990144 1380 raft_consensus.cc:348] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.990370 1380 raft_consensus.cc:374] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.990468 1380 raft_consensus.cc:729] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.990716 1380 consensus_queue.cc:260] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.991261 1380 ts_tablet_manager.cc:1428] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260621 02:41:54.991304 1398 ts_tablet_manager.cc:1918] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:54.991423 1398 log.cc:1196] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/efbc3adb80704c6d8726167312ab1866
I20260621 02:41:54.991590 1380 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:54.991870 1398 ts_tablet_manager.cc:1939] T efbc3adb80704c6d8726167312ab1866 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:54.993316 1380 tablet_bootstrap.cc:654] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:54.993319 1377 ts_tablet_manager.cc:1428] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260621 02:41:54.995440 1376 tablet_bootstrap.cc:492] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:54.995654 1376 ts_tablet_manager.cc:1397] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.006s
I20260621 02:41:54.996479 1376 raft_consensus.cc:348] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.997668 1380 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:54.997823 1376 raft_consensus.cc:374] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:54.998054 1380 ts_tablet_manager.cc:1397] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260621 02:41:54.998198 1376 raft_consensus.cc:729] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:54.998504 1376 consensus_queue.cc:260] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:54.999540 1380 raft_consensus.cc:348] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.000286 1376 ts_tablet_manager.cc:1428] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260621 02:41:55.000626 1376 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.000789 1380 raft_consensus.cc:374] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.000937 1380 raft_consensus.cc:729] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.002764 1376 tablet_bootstrap.cc:654] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.003114 1380 consensus_queue.cc:260] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.004184 1380 ts_tablet_manager.cc:1428] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260621 02:41:55.009524 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet efbc3adb80704c6d8726167312ab1866 (table default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:55.015677 1376 tablet_bootstrap.cc:492] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.015887 1376 ts_tablet_manager.cc:1397] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260621 02:41:55.016686 1376 raft_consensus.cc:348] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.016953 1376 raft_consensus.cc:374] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.017052 1376 raft_consensus.cc:729] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.017293 1376 consensus_queue.cc:260] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.017985 1376 ts_tablet_manager.cc:1428] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260621 02:41:55.019434 792 catalog_manager.cc:2148] created HMS catalog entry for table [id=5a1f4f5b120142c7a45800a60af93b51]
I20260621 02:41:55.025956 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 9) took 1055 ms. Trace:
I20260621 02:41:55.026134 792 rpcz_store.cc:276] 0621 02:41:53.970485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:53.970550 (+ 65us) service_pool.cc:227] Handling call
0621 02:41:54.534141 (+563591us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:54.534654 (+ 513us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:55.019375 (+484721us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:55.025660 (+ 6285us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:55.025789 (+ 129us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:55.025908 (+ 119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:55.020370 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:55.020501 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:55.020507 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:55.020510 (+ 3us) tablet.cc:660] Decoding operations
0621 02:41:55.020614 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:55.020629 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:55.020633 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:55.020725 (+ 92us) tablet.cc:699] Row locks acquired
0621 02:41:55.020727 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:55.020769 (+ 42us) write_op.cc:270] Start()
0621 02:41:55.020819 (+ 50us) write_op.cc:276] Timestamp: P: 1782009715020692 usec, L: 0
0621 02:41:55.020822 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:55.021050 (+ 228us) log.cc:842] Serialized 432 byte log entry
0621 02:41:55.024852 (+ 3802us) op_driver.cc:444] REPLICATION: finished
0621 02:41:55.025015 (+ 163us) write_op.cc:301] APPLY: starting
0621 02:41:55.025032 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:55.025081 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:55.025107 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:55.025212 (+ 105us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:55.025250 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:55.025255 (+ 5us) write_op.cc:312] APPLY: finished
0621 02:41:55.025339 (+ 84us) log.cc:842] Serialized 28 byte log entry
0621 02:41:55.025459 (+ 120us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.025482 (+ 23us) write_op.cc:454] Released schema lock
0621 02:41:55.025490 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:55.025547 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.025551 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":284765,"Hive Metastore.run_cpu_time_us":290,"Hive Metastore.run_wall_time_us":199752,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":587,"num_ops":2,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":797,"prepare.run_wall_time_us":798,"raft.queue_time_us":1284,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":254,"replication_time_us":4005}]]}
I20260621 02:41:55.032806 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet efbc3adb80704c6d8726167312ab1866 with delete_type TABLET_DATA_DELETED (replaced by tablet 0603aaa2e9b94ea48c859c08018055e5) from {username='slave'} at 127.0.0.1:38742
W20260621 02:41:55.035019 787 catalog_manager.cc:4808] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): delete failed for tablet efbc3adb80704c6d8726167312ab1866 because the tablet was not found. No further retry: Not found: Tablet not found: efbc3adb80704c6d8726167312ab1866
I20260621 02:41:55.038949 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:55.039274 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:55.045712 1107 tablet_service.cc:1467] Processing CreateTablet for tablet a9ecff86eae34204a735dca560a2f85b (DEFAULT_TABLE table=default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.045688 969 tablet_service.cc:1467] Processing CreateTablet for tablet a9ecff86eae34204a735dca560a2f85b (DEFAULT_TABLE table=default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.046203 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ecff86eae34204a735dca560a2f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.046223 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ecff86eae34204a735dca560a2f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.053870 1380 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:55.055637 1380 tablet_bootstrap.cc:654] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.062096 793 catalog_manager.cc:2148] created HMS catalog entry for table [id=89b656341812498ebe18e263aee13d05]
I20260621 02:41:55.068619 1376 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.070369 1376 tablet_bootstrap.cc:654] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.078081 1376 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.078352 1376 ts_tablet_manager.cc:1397] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260621 02:41:55.079324 1376 raft_consensus.cc:348] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.079651 1376 raft_consensus.cc:374] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.079806 1376 raft_consensus.cc:729] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.080168 1376 consensus_queue.cc:260] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.081777 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_55949c61dce74206ba47a1657f192207"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:55.086655 1376 ts_tablet_manager.cc:1428] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260621 02:41:55.090626 1380 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:55.090692 1242 tablet_service.cc:1467] Processing CreateTablet for tablet a9ecff86eae34204a735dca560a2f85b (DEFAULT_TABLE table=default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.090842 1380 ts_tablet_manager.cc:1397] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.009s
I20260621 02:41:55.091166 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9ecff86eae34204a735dca560a2f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.091615 1380 raft_consensus.cc:348] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.091847 1380 raft_consensus.cc:374] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.091933 1380 raft_consensus.cc:729] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.092195 1380 consensus_queue.cc:260] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.096063 1380 ts_tablet_manager.cc:1428] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260621 02:41:55.097713 1377 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:55.099568 1377 tablet_bootstrap.cc:654] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.102265 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b2f231e0731496d9ea9e6180617bcb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 2540f7a8633748fdb8c43f8156e99ccf) from {username='slave'} at 127.0.0.1:38742
W20260621 02:41:55.105751 787 catalog_manager.cc:4808] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): delete failed for tablet 7b2f231e0731496d9ea9e6180617bcb1 because the tablet was not found. No further retry: Not found: Tablet not found: 7b2f231e0731496d9ea9e6180617bcb1
I20260621 02:41:55.110193 797 catalog_manager.cc:2148] created HMS catalog entry for table [id=7fad0ad501a942efa6a0f0a731be5fc6]
I20260621 02:41:55.110752 793 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 8) took 1142 ms. Trace:
I20260621 02:41:55.110894 793 rpcz_store.cc:276] 0621 02:41:53.968367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:53.969116 (+ 749us) service_pool.cc:227] Handling call
0621 02:41:54.534230 (+565114us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x61200001a4c8. stack: 00007f88c22e166e 00007f88c22e1430 00007f88c13685ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f88c22d70fd 00007f88c22d6d1e 00007f88d51e03cd 00007f88d51e036c 00007f88d53e0d38 00007f88d51afdec 00007f88d51156f9 00007f88d531746a 00007f88cc609466 00007f88cc609195
0621 02:41:54.534436 (+ 206us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:54.535053 (+ 617us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:55.062026 (+526973us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:55.110463 (+ 48437us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:55.110591 (+ 128us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:55.110700 (+ 109us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:55.063137 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:55.063347 (+ 210us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:55.063356 (+ 9us) write_op.cc:435] Acquired schema lock
0621 02:41:55.063360 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:55.063523 (+ 163us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:55.063553 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:55.063562 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:55.063699 (+ 137us) tablet.cc:699] Row locks acquired
0621 02:41:55.063703 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:55.063772 (+ 69us) write_op.cc:270] Start()
0621 02:41:55.063816 (+ 44us) write_op.cc:276] Timestamp: P: 1782009715063673 usec, L: 0
0621 02:41:55.063822 (+ 6us) op_driver.cc:331] REPLICATION: starting
0621 02:41:55.064070 (+ 248us) log.cc:842] Serialized 432 byte log entry
0621 02:41:55.109389 (+ 45319us) op_driver.cc:444] REPLICATION: finished
0621 02:41:55.109555 (+ 166us) write_op.cc:301] APPLY: starting
0621 02:41:55.109575 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:55.109624 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:55.109660 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:55.109785 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:55.109832 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:55.109843 (+ 11us) write_op.cc:312] APPLY: finished
0621 02:41:55.109942 (+ 99us) log.cc:842] Serialized 28 byte log entry
0621 02:41:55.110013 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.110040 (+ 27us) write_op.cc:454] Released schema lock
0621 02:41:55.110049 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:55.110114 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.110117 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":484147,"Hive Metastore.run_cpu_time_us":316,"Hive Metastore.run_wall_time_us":42626,"spinlock_wait_cycles":3151488,"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":621,"apply.run_wall_time_us":623,"num_ops":2,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":881,"prepare.run_wall_time_us":1052,"replication_time_us":45515}]]}
I20260621 02:41:55.133869 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 4) took 1168 ms. Trace:
I20260621 02:41:55.134043 797 rpcz_store.cc:276] 0621 02:41:53.965167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:53.965250 (+ 83us) service_pool.cc:227] Handling call
0621 02:41:53.968142 (+ 2892us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x615000033024. stack: 00007f88c22e166e 00007f88c22e1430 00007f88c13685ed 00000000008ea064 00000000008ea02d 00007f88d09fa27d 00007f88d09fa373 00007f88cd81c361 00007f88d518f66a 00007f88d5317313 00007f88cc609466 00007f88cc609195 00007f88c8e1d9be 00007f88c8e1c79e 00007f88c8e22b25 00007f88c8e2354f
0621 02:41:54.533837 (+565695us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:54.535684 (+ 1847us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:55.110129 (+574445us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:55.133566 (+ 23437us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:55.133700 (+ 134us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:55.133817 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:55.110982 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:55.111102 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:55.111109 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:55.111111 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:55.111203 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:55.111215 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:55.111220 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:55.111347 (+ 127us) tablet.cc:699] Row locks acquired
0621 02:41:55.111350 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:55.111390 (+ 40us) write_op.cc:270] Start()
0621 02:41:55.111422 (+ 32us) write_op.cc:276] Timestamp: P: 1782009715111296 usec, L: 0
0621 02:41:55.111426 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:55.111601 (+ 175us) log.cc:842] Serialized 432 byte log entry
0621 02:41:55.125690 (+ 14089us) op_driver.cc:444] REPLICATION: finished
0621 02:41:55.125936 (+ 246us) write_op.cc:301] APPLY: starting
0621 02:41:55.125953 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:55.125998 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:55.126023 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:55.126127 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:55.126163 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:55.126168 (+ 5us) write_op.cc:312] APPLY: finished
0621 02:41:55.126249 (+ 81us) log.cc:842] Serialized 28 byte log entry
0621 02:41:55.126329 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.126349 (+ 20us) write_op.cc:454] Released schema lock
0621 02:41:55.126356 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:55.126413 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.126417 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":526209,"Hive Metastore.run_cpu_time_us":285,"Hive Metastore.run_wall_time_us":47875,"spinlock_wait_cycles":5042432,"child_traces":[["op",{"apply.queue_time_us":195,"num_ops":2,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":722,"raft.queue_time_us":5142,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":12,"replication_time_us":14239}]]}
I20260621 02:41:55.141144 969 tablet_service.cc:1467] Processing CreateTablet for tablet 97f3b4a1836740df984e0f5329267930 (DEFAULT_TABLE table=default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.141741 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f3b4a1836740df984e0f5329267930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.146322 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 97f3b4a1836740df984e0f5329267930 (DEFAULT_TABLE table=default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.146828 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f3b4a1836740df984e0f5329267930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.151278 791 catalog_manager.cc:2148] created HMS catalog entry for table [id=f046222f946a4a3cb4fb98ba9673fad6]
I20260621 02:41:55.161398 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 97f3b4a1836740df984e0f5329267930 (DEFAULT_TABLE table=default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.161931 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f3b4a1836740df984e0f5329267930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.175261 793 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_6edd16d2d48f4b57a8f4f99ec6043589" } new_table_name: "default.Table_faabbcd5060949a29d7f5c57526fb922" modify_external_catalogs: true
I20260621 02:41:55.179970 1376 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.181818 1376 tablet_bootstrap.cc:654] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.181936 1380 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:55.183259 1377 tablet_bootstrap.cc:492] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:55.183571 1377 ts_tablet_manager.cc:1397] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.005s
I20260621 02:41:55.183624 1380 tablet_bootstrap.cc:654] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.184531 1377 raft_consensus.cc:348] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.184975 1377 raft_consensus.cc:374] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.185134 1377 raft_consensus.cc:729] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.185876 1377 consensus_queue.cc:260] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.186781 1376 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.186961 1376 ts_tablet_manager.cc:1397] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260621 02:41:55.187745 1376 raft_consensus.cc:348] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.187999 1376 raft_consensus.cc:374] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.188072 1376 raft_consensus.cc:729] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.188316 1376 consensus_queue.cc:260] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.188898 1376 ts_tablet_manager.cc:1428] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260621 02:41:55.194381 1377 ts_tablet_manager.cc:1428] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260621 02:41:55.195786 1377 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:55.196748 1383 raft_consensus.cc:482] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.196996 1383 raft_consensus.cc:504] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.197549 1377 tablet_bootstrap.cc:654] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.199064 1383 leader_election.cc:288] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:55.199680 1377 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:55.199821 1380 tablet_bootstrap.cc:492] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:55.199986 1380 ts_tablet_manager.cc:1397] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.006s
I20260621 02:41:55.200006 1377 ts_tablet_manager.cc:1397] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260621 02:41:55.200712 1380 raft_consensus.cc:348] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.200973 1380 raft_consensus.cc:374] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.201045 1380 raft_consensus.cc:729] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.200786 1377 raft_consensus.cc:348] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.201150 1377 raft_consensus.cc:374] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.201236 1377 raft_consensus.cc:729] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.201536 1392 raft_consensus.cc:482] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.201612 1377 consensus_queue.cc:260] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.201671 1392 raft_consensus.cc:504] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.202289 1392 leader_election.cc:288] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.202340 1377 ts_tablet_manager.cc:1428] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260621 02:41:55.203154 990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc0581f165c4a46a59516c65f820f19" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.203197 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc0581f165c4a46a59516c65f820f19" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.203449 990 raft_consensus.cc:2454] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:55.203462 1128 raft_consensus.cc:2454] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:55.204015 1196 leader_election.cc:302] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.204401 1392 raft_consensus.cc:2781] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.204523 1392 raft_consensus.cc:482] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.204612 1392 raft_consensus.cc:3037] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.208323 1392 raft_consensus.cc:504] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.212159 797 catalog_manager.cc:5495] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:55.216001 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 10) took 1245 ms. Trace:
I20260621 02:41:55.216140 791 rpcz_store.cc:276] 0621 02:41:53.971003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:53.971150 (+ 147us) service_pool.cc:227] Handling call
0621 02:41:54.533060 (+561910us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:54.533564 (+ 504us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:55.151200 (+617636us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:55.211021 (+ 59821us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:55.215838 (+ 4817us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:55.215947 (+ 109us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:55.152107 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:55.152244 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:55.152251 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:55.152253 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:55.152368 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:55.152385 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:55.152390 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:55.152475 (+ 85us) tablet.cc:699] Row locks acquired
0621 02:41:55.152478 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:55.152522 (+ 44us) write_op.cc:270] Start()
0621 02:41:55.152559 (+ 37us) write_op.cc:276] Timestamp: P: 1782009715152417 usec, L: 0
0621 02:41:55.152562 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:55.172166 (+ 19604us) log.cc:842] Serialized 432 byte log entry
0621 02:41:55.172537 (+ 371us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x615000033024. stack: 00007f88c22e166e 00007f88c22e1430 00007f88c13685ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f88cd7efd02 00007f88ceb227f1 00007f88ceb21359 00007f88ceb291bb 00007f88ceb29038 00000000009edb7c 00007f88c2327344 00007f88c232a91b 00007f88c232a798 00000000009edb7c
0621 02:41:55.209044 (+ 36507us) op_driver.cc:444] REPLICATION: finished
0621 02:41:55.209277 (+ 233us) write_op.cc:301] APPLY: starting
0621 02:41:55.209303 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:55.209402 (+ 99us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:55.209407 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:55.209557 (+ 150us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:55.209611 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:55.209620 (+ 9us) write_op.cc:312] APPLY: finished
0621 02:41:55.209735 (+ 115us) log.cc:842] Serialized 28 byte log entry
0621 02:41:55.209861 (+ 126us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.209888 (+ 27us) write_op.cc:454] Released schema lock
0621 02:41:55.209897 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:55.209978 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.209983 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":576281,"Hive Metastore.run_cpu_time_us":286,"Hive Metastore.run_wall_time_us":41162,"mutex_wait_us":2223,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":779,"apply.run_wall_time_us":789,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1641,"prepare.run_wall_time_us":20528,"raft.queue_time_us":89,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":5,"replication_time_us":56445,"spinlock_wait_cycles":44509440}]]}
I20260621 02:41:55.220292 969 tablet_service.cc:1467] Processing CreateTablet for tablet 3cefa90be47244babf78e52753e663d5 (DEFAULT_TABLE table=default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.220736 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cefa90be47244babf78e52753e663d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.225850 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 3cefa90be47244babf78e52753e663d5 (DEFAULT_TABLE table=default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.226404 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cefa90be47244babf78e52753e663d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.219966 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 3cefa90be47244babf78e52753e663d5 (DEFAULT_TABLE table=default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.233343 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cefa90be47244babf78e52753e663d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.238483 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9ecff86eae34204a735dca560a2f85b" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.238778 1128 raft_consensus.cc:2454] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.239282 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc0581f165c4a46a59516c65f820f19" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.239497 1128 raft_consensus.cc:3037] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.239426 926 leader_election.cc:302] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:55.239919 1383 raft_consensus.cc:2781] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.240057 1383 raft_consensus.cc:482] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.240140 1383 raft_consensus.cc:3037] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.242980 1128 raft_consensus.cc:2454] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.243564 1198 leader_election.cc:302] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.243902 1393 raft_consensus.cc:2781] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.244103 1393 raft_consensus.cc:686] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:55.244437 1393 consensus_queue.cc:237] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.246114 1392 leader_election.cc:288] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.256055 1377 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:55.258574 1377 tablet_bootstrap.cc:654] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.262331 1377 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:55.262579 1377 ts_tablet_manager.cc:1397] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260621 02:41:55.262599 1376 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.263671 1377 raft_consensus.cc:348] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.264019 1377 raft_consensus.cc:374] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.264164 1377 raft_consensus.cc:729] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.264430 1376 tablet_bootstrap.cc:654] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.264511 1377 consensus_queue.cc:260] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.265123 1377 ts_tablet_manager.cc:1428] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260621 02:41:55.266410 798 catalog_manager.cc:2148] created HMS catalog entry for table [id=478b269794fe46dfa698bdbcf84abc0d]
I20260621 02:41:55.271549 1383 raft_consensus.cc:504] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.272794 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9ecff86eae34204a735dca560a2f85b" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.273108 1128 raft_consensus.cc:3037] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.277444 1383 leader_election.cc:288] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:55.283550 1128 raft_consensus.cc:2454] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.284255 926 leader_election.cc:302] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:55.284770 1383 raft_consensus.cc:2781] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.201300 1380 consensus_queue.cc:260] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.296545 1386 raft_consensus.cc:482] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.296808 1386 raft_consensus.cc:504] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.302291 1386 leader_election.cc:288] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.302933 1386 raft_consensus.cc:482] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.303639 1386 raft_consensus.cc:504] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.305857 1386 leader_election.cc:288] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.306499 1386 raft_consensus.cc:482] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.307045 1386 raft_consensus.cc:504] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.309087 1386 leader_election.cc:288] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.317013 1263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f3b4a1836740df984e0f5329267930" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.317572 1263 raft_consensus.cc:2454] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.318148 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2540f7a8633748fdb8c43f8156e99ccf" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.318472 1262 raft_consensus.cc:2454] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.318885 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0603aaa2e9b94ea48c859c08018055e5" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.319154 1261 raft_consensus.cc:2454] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.320029 1065 leader_election.cc:302] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.320537 1065 leader_election.cc:302] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.320823 1065 leader_election.cc:302] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.321820 1386 raft_consensus.cc:2781] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.322008 1386 raft_consensus.cc:482] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.322186 1386 raft_consensus.cc:3037] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.326093 1386 raft_consensus.cc:504] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.331632 1435 raft_consensus.cc:2781] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.336587 1435 raft_consensus.cc:482] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.336826 1435 raft_consensus.cc:3037] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.332068 1380 ts_tablet_manager.cc:1428] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.132s user 0.002s sys 0.000s
I20260621 02:41:55.337788 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f3b4a1836740df984e0f5329267930" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.338014 1261 raft_consensus.cc:3037] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.338604 1380 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:55.340516 1380 tablet_bootstrap.cc:654] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.340364 1435 raft_consensus.cc:504] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.340972 1261 raft_consensus.cc:2454] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.341341 1435 leader_election.cc:288] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.341645 1435 raft_consensus.cc:2781] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.341765 1435 raft_consensus.cc:482] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.341872 1435 raft_consensus.cc:3037] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.343822 1065 leader_election.cc:302] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.345032 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2540f7a8633748fdb8c43f8156e99ccf" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.345057 1435 raft_consensus.cc:504] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.345427 1261 raft_consensus.cc:3037] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.345666 1435 leader_election.cc:288] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.345999 1435 raft_consensus.cc:2781] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.346145 1435 raft_consensus.cc:686] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:55.346571 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0603aaa2e9b94ea48c859c08018055e5" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.346536 1435 consensus_queue.cc:237] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.346779 1262 raft_consensus.cc:3037] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.350855 1262 raft_consensus.cc:2454] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.351624 1065 leader_election.cc:302] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.355034 1261 raft_consensus.cc:2454] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.355419 1431 raft_consensus.cc:2781] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.355659 1431 raft_consensus.cc:686] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:55.356496 1065 leader_election.cc:302] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.356314 1431 consensus_queue.cc:237] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.359334 1386 leader_election.cc:288] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:55.359642 1386 raft_consensus.cc:2781] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.359778 1386 raft_consensus.cc:686] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:55.361003 1386 consensus_queue.cc:237] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.368615 1383 raft_consensus.cc:686] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:55.369127 990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f3b4a1836740df984e0f5329267930" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.369418 990 raft_consensus.cc:2454] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.369297 1383 consensus_queue.cc:237] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.369712 991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2540f7a8633748fdb8c43f8156e99ccf" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.369917 991 raft_consensus.cc:2454] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.370249 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0603aaa2e9b94ea48c859c08018055e5" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.370626 989 raft_consensus.cc:2454] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:55.371071 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2540f7a8633748fdb8c43f8156e99ccf" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.371310 988 raft_consensus.cc:3037] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.373611 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0603aaa2e9b94ea48c859c08018055e5" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.373936 987 raft_consensus.cc:3037] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.374241 1376 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.374433 1376 ts_tablet_manager.cc:1397] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.008s
I20260621 02:41:55.375560 1376 raft_consensus.cc:348] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.375870 1376 raft_consensus.cc:374] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.376001 1376 raft_consensus.cc:729] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.376237 1376 consensus_queue.cc:260] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.377677 986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f3b4a1836740df984e0f5329267930" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.377955 986 raft_consensus.cc:3037] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.378429 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc0581f165c4a46a59516c65f820f19" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.378602 989 raft_consensus.cc:3037] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.382134 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9ecff86eae34204a735dca560a2f85b" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.382450 1261 raft_consensus.cc:2454] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.383316 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9ecff86eae34204a735dca560a2f85b" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.383531 1261 raft_consensus.cc:3037] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.384115 986 raft_consensus.cc:2454] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.385052 987 raft_consensus.cc:2454] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.387117 1261 raft_consensus.cc:2454] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.391006 791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_4e260ee413ad41378c547ad6650740fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:55.394770 989 raft_consensus.cc:2454] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.395454 988 raft_consensus.cc:2454] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:55.397480 1376 ts_tablet_manager.cc:1428] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260621 02:41:55.397746 1380 tablet_bootstrap.cc:492] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:55.397941 1380 ts_tablet_manager.cc:1397] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20260621 02:41:55.399132 1380 raft_consensus.cc:348] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.399441 1380 raft_consensus.cc:374] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.399528 1380 raft_consensus.cc:729] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.399998 1380 consensus_queue.cc:260] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.400713 1380 ts_tablet_manager.cc:1428] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260621 02:41:55.403616 1065 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.97.3:36259, user_credentials={real_user=slave}} blocked reactor thread for 47081.9us
I20260621 02:41:55.409650 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 3) took 1444 ms. Trace:
I20260621 02:41:55.409797 798 rpcz_store.cc:276] 0621 02:41:53.965035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:53.965776 (+ 741us) service_pool.cc:227] Handling call
0621 02:41:54.661054 (+695278us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:54.661661 (+ 607us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:55.266359 (+604698us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:55.409409 (+143050us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:55.409519 (+ 110us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:55.409608 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:55.392066 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:55.392220 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:55.392230 (+ 10us) write_op.cc:435] Acquired schema lock
0621 02:41:55.392234 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:55.392364 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:55.392381 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:55.392388 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:55.392509 (+ 121us) tablet.cc:699] Row locks acquired
0621 02:41:55.392513 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:55.392561 (+ 48us) write_op.cc:270] Start()
0621 02:41:55.392607 (+ 46us) write_op.cc:276] Timestamp: P: 1782009715392505 usec, L: 0
0621 02:41:55.392614 (+ 7us) op_driver.cc:331] REPLICATION: starting
0621 02:41:55.392778 (+ 164us) log.cc:842] Serialized 432 byte log entry
0621 02:41:55.408045 (+ 15267us) op_driver.cc:444] REPLICATION: finished
0621 02:41:55.408654 (+ 609us) write_op.cc:301] APPLY: starting
0621 02:41:55.408662 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:55.408691 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:55.408748 (+ 57us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:55.408847 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:55.408872 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:55.408878 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:55.408922 (+ 44us) log.cc:842] Serialized 28 byte log entry
0621 02:41:55.408955 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.408969 (+ 14us) write_op.cc:454] Released schema lock
0621 02:41:55.408974 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:55.409016 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:55.409019 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":495622,"Hive Metastore.run_cpu_time_us":258,"Hive Metastore.run_wall_time_us":108630,"mutex_wait_us":8043,"child_traces":[["op",{"apply.queue_time_us":584,"apply.run_cpu_time_us":398,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":124930,"prepare.run_cpu_time_us":804,"prepare.run_wall_time_us":804,"raft.queue_time_us":1335,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":2,"replication_time_us":15419}]]}
I20260621 02:41:55.410741 798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_a150263b166249fa86e82c610ad9270b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:55.417660 797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_7316d10767b943a3972b1a92374e24c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:55.426250 969 tablet_service.cc:1467] Processing CreateTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.426738 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750ee0afb60d44c4b6d70947edcc9096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.431102 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.431671 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750ee0afb60d44c4b6d70947edcc9096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.445833 1107 tablet_service.cc:1467] Processing CreateTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.446298 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 750ee0afb60d44c4b6d70947edcc9096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.451392 1377 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:55.452972 1376 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.453171 1377 tablet_bootstrap.cc:654] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.454891 1376 tablet_bootstrap.cc:654] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.477821 1109 tablet_service.cc:1467] Processing CreateTablet for tablet b21ad2c9db57446492a0329f899a1afe (DEFAULT_TABLE table=default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.478521 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b21ad2c9db57446492a0329f899a1afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.482980 969 tablet_service.cc:1467] Processing CreateTablet for tablet b21ad2c9db57446492a0329f899a1afe (DEFAULT_TABLE table=default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.483639 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b21ad2c9db57446492a0329f899a1afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.498513 1242 tablet_service.cc:1467] Processing CreateTablet for tablet b21ad2c9db57446492a0329f899a1afe (DEFAULT_TABLE table=default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:55.499156 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b21ad2c9db57446492a0329f899a1afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:55.510165 1380 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:55.513221 1380 tablet_bootstrap.cc:654] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.521605 1376 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.521944 1376 ts_tablet_manager.cc:1397] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.000s
I20260621 02:41:55.523036 1376 raft_consensus.cc:348] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.523635 1376 raft_consensus.cc:374] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.523813 1376 raft_consensus.cc:729] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.524222 1376 consensus_queue.cc:260] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.525012 1376 ts_tablet_manager.cc:1428] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260621 02:41:55.525521 1376 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:55.527632 1376 tablet_bootstrap.cc:654] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.530136 1377 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:55.530346 1377 ts_tablet_manager.cc:1397] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.079s user 0.014s sys 0.049s
I20260621 02:41:55.531368 1377 raft_consensus.cc:348] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.531687 1377 raft_consensus.cc:374] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.531780 1377 raft_consensus.cc:729] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.532106 1377 consensus_queue.cc:260] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.533420 1376 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:55.533622 1376 ts_tablet_manager.cc:1397] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260621 02:41:55.534539 1380 tablet_bootstrap.cc:492] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:55.534723 1380 ts_tablet_manager.cc:1397] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.008s
I20260621 02:41:55.534463 1376 raft_consensus.cc:348] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.534904 1376 raft_consensus.cc:374] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.535055 1376 raft_consensus.cc:729] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.535360 1376 consensus_queue.cc:260] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.535568 1380 raft_consensus.cc:348] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.535804 1380 raft_consensus.cc:374] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.535888 1380 raft_consensus.cc:729] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.536079 1376 ts_tablet_manager.cc:1428] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:55.536160 1380 consensus_queue.cc:260] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.536516 1377 ts_tablet_manager.cc:1428] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260621 02:41:55.537002 1377 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:55.538128 1380 ts_tablet_manager.cc:1428] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260621 02:41:55.539287 1377 tablet_bootstrap.cc:654] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.540457 1380 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:55.542725 1380 tablet_bootstrap.cc:654] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:55.548368 1380 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:55.548599 1380 ts_tablet_manager.cc:1397] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260621 02:41:55.548697 1377 tablet_bootstrap.cc:492] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:55.548874 1377 ts_tablet_manager.cc:1397] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260621 02:41:55.549559 1380 raft_consensus.cc:348] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.549698 1377 raft_consensus.cc:348] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.549990 1377 raft_consensus.cc:374] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.550091 1377 raft_consensus.cc:729] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.550117 1380 raft_consensus.cc:374] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:55.550294 1380 raft_consensus.cc:729] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:55.550326 1377 consensus_queue.cc:260] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.550570 1380 consensus_queue.cc:260] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.553035 1377 ts_tablet_manager.cc:1428] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260621 02:41:55.558503 1380 ts_tablet_manager.cc:1428] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260621 02:41:55.582438 1383 raft_consensus.cc:482] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.582664 1383 raft_consensus.cc:504] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.583343 1383 leader_election.cc:288] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:55.584318 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dac6c7a546048d6ae29186f789ca188" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.584573 1128 raft_consensus.cc:2454] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.585352 926 leader_election.cc:302] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:55.585469 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dac6c7a546048d6ae29186f789ca188" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.585711 1261 raft_consensus.cc:2454] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.585837 1383 raft_consensus.cc:2781] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.585970 1383 raft_consensus.cc:482] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.586069 1383 raft_consensus.cc:3037] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.589025 1383 raft_consensus.cc:504] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.589883 1383 leader_election.cc:288] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:55.590626 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dac6c7a546048d6ae29186f789ca188" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.590886 1128 raft_consensus.cc:3037] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.590808 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dac6c7a546048d6ae29186f789ca188" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.591074 1261 raft_consensus.cc:3037] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.594357 1261 raft_consensus.cc:2454] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.595000 1128 raft_consensus.cc:2454] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.595405 927 leader_election.cc:302] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.595801 1383 raft_consensus.cc:2781] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.595969 1383 raft_consensus.cc:686] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:55.596212 1383 consensus_queue.cc:237] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.616839 1128 raft_consensus.cc:3037] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.621301 1393 consensus_queue.cc:1035] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:55.631664 1392 raft_consensus.cc:482] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.631860 1392 raft_consensus.cc:504] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.632483 1392 leader_election.cc:288] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.633189 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750ee0afb60d44c4b6d70947edcc9096" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.633318 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750ee0afb60d44c4b6d70947edcc9096" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.633527 988 raft_consensus.cc:2454] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:55.633646 1127 raft_consensus.cc:2454] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:55.633987 1196 leader_election.cc:302] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.634307 1392 raft_consensus.cc:2781] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.634418 1392 raft_consensus.cc:482] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.634496 1392 raft_consensus.cc:3037] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.637645 1392 raft_consensus.cc:504] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.638988 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750ee0afb60d44c4b6d70947edcc9096" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.639252 988 raft_consensus.cc:3037] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.642547 988 raft_consensus.cc:2454] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.643146 1196 leader_election.cc:302] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.643486 1382 raft_consensus.cc:2781] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.646447 1392 leader_election.cc:288] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.649119 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "750ee0afb60d44c4b6d70947edcc9096" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.649833 1126 raft_consensus.cc:3037] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.654488 1393 consensus_queue.cc:1035] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:55.666632 1126 raft_consensus.cc:2454] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.670831 1382 raft_consensus.cc:686] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:55.671202 1382 consensus_queue.cc:237] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
W20260621 02:41:55.726596 1402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:41:55.727104 1402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:41:55.727260 1402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:41:55.746225 1402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:41:55.746438 1402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:41:55.746534 1402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:41:55.746621 1402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:41:55.760916 1402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=37371
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:41:55.762811 1402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:41:55.765348 1402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260621 02:41:55.786749 1382 raft_consensus.cc:482] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.786969 1382 raft_consensus.cc:504] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.787668 1382 leader_election.cc:288] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.788647 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cefa90be47244babf78e52753e663d5" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:55.788920 988 raft_consensus.cc:2454] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:55.790024 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cefa90be47244babf78e52753e663d5" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.790369 1128 raft_consensus.cc:2454] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
W20260621 02:41:55.790562 1461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:55.791141 1196 leader_election.cc:302] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.792049 1382 raft_consensus.cc:2781] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.792173 1382 raft_consensus.cc:482] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.792290 1382 raft_consensus.cc:3037] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
W20260621 02:41:55.795224 1460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:55.796411 1382 raft_consensus.cc:504] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.798074 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cefa90be47244babf78e52753e663d5" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:55.798360 988 raft_consensus.cc:3037] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.803154 988 raft_consensus.cc:2454] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.804574 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cefa90be47244babf78e52753e663d5" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.804890 1128 raft_consensus.cc:3037] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.809412 1128 raft_consensus.cc:2454] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:55.810316 1198 leader_election.cc:302] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.810772 1452 raft_consensus.cc:2781] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.810979 1452 raft_consensus.cc:686] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:55.811372 1452 consensus_queue.cc:237] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:55.816355 1382 leader_election.cc:288] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.828109 1402 server_base.cc:1034] running on GCE node
W20260621 02:41:55.829238 1464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:41:55.830559 1402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:41:55.832464 1402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:41:55.833765 1402 hybrid_clock.cc:648] HybridClock initialized: now 1782009715833675 us; error 70 us; skew 500 ppm
I20260621 02:41:55.834218 1402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:41:55.841171 1402 webserver.cc:460] Webserver started at http://127.0.97.62:37371/ using document root <none> and password file <none>
I20260621 02:41:55.842254 1402 fs_manager.cc:359] Metadata directory not provided
I20260621 02:41:55.842427 1402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:41:55.843955 799 catalog_manager.cc:3411] renamed table default.table_f8dfd6e6d9ff452eb1a8f384a50144d4 [id=00bcbcf024244266942dbcf393b15aaf] in HMS: new name default.table_601222202f6f400f8d5b26bf198ae4d6
I20260621 02:41:55.849526 1402 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.004s
I20260621 02:41:55.853569 1383 raft_consensus.cc:482] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:55.853767 1383 raft_consensus.cc:504] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.853806 1470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:41:55.854514 1383 leader_election.cc:288] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.855731 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b21ad2c9db57446492a0329f899a1afe" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:55.855995 1261 raft_consensus.cc:2454] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.856482 1402 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260621 02:41:55.856401 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b21ad2c9db57446492a0329f899a1afe" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:55.856671 1128 raft_consensus.cc:2454] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:55.857645 926 leader_election.cc:302] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:55.856660 1402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:41:55.858042 1402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:41:55.858601 1383 raft_consensus.cc:2781] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:55.858741 1383 raft_consensus.cc:482] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:55.858876 1383 raft_consensus.cc:3037] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.869818 1383 raft_consensus.cc:504] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.871308 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b21ad2c9db57446492a0329f899a1afe" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:55.871562 1261 raft_consensus.cc:3037] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.874606 1261 raft_consensus.cc:2454] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.875211 927 leader_election.cc:302] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:55.875576 1430 raft_consensus.cc:2781] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:55.878700 1128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b21ad2c9db57446492a0329f899a1afe" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:55.879001 1128 raft_consensus.cc:3037] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:55.882015 1128 raft_consensus.cc:2454] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:55.882877 1383 leader_election.cc:288] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:55.893734 1430 raft_consensus.cc:686] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:55.894215 1430 consensus_queue.cc:237] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:55.963536 1402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:41:55.964717 1402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:41:55.965134 1402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:41:55.983863 796 catalog_manager.cc:3411] renamed table default.table_8ff1127b12c8401785fa7302af1a87d9 [id=234547ee10c2455ab7f7bf73231ad6ee] in HMS: new name default.table_712b123abad04ea6ac57e7b5d5af879b
I20260621 02:41:55.991590 1494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:55.991912 1494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:56.000531 1494 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:56.001071 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
W20260621 02:41:56.010798 717 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:41:56.011027 717 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:56.011353 1494 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260621 02:41:56.030560 1402 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:44219
I20260621 02:41:56.030584 1526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:44219 every 8 connection(s)
I20260621 02:41:56.032897 1402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
I20260621 02:41:56.039364 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 1402
I20260621 02:41:56.064347 1527 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:41:56.070317 1527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap starting.
I20260621 02:41:56.081903 1527 log.cc:824] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Log is configured to *not* fsync() on all Append() calls
I20260621 02:41:56.093021 1527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 02:41:56.094290 1527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap complete.
I20260621 02:41:56.096083 795 catalog_manager.cc:3411] renamed table default.table_01693932aef84215b8b138fc1298be91 [id=334d63b5eaaf48de9bc46f4473bea4af] in HMS: new name default.table_65a5205e941c44c5bdc59e0846793cb3
I20260621 02:41:56.105284 1527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:56.106680 1527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.107669 1527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:56.110144 1536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:56.111135 1536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:56.111594 1527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: configured and running, proceeding with master startup.
W20260621 02:41:56.123150 874 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0603aaa2e9b94ea48c859c08018055e5 consensus state has no leader
I20260621 02:41:56.129119 1309 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:56.127461 1543 tablet.cc:1722] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.136098 1542 tablet.cc:1722] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.138667 1544 tablet.cc:1722] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260621 02:41:56.140250 874 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2540f7a8633748fdb8c43f8156e99ccf consensus state has no leader
W20260621 02:41:56.141019 800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7ef13b7647da48208cd992f8af548202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:56.144441 792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_55949c61dce74206ba47a1657f192207 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:56.149837 1037 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
W20260621 02:41:56.157562 785 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0603aaa2e9b94ea48c859c08018055e5 consensus state has no leader
I20260621 02:41:56.168497 1175 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:56.169986 1435 consensus_queue.cc:1035] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.187881 1555 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260621 02:41:56.191627 1488 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:40085; Asking this server to re-register.
I20260621 02:41:56.195164 1435 consensus_queue.cc:1035] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.201472 1309 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:56.204219 1037 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:41:56.204478 1488 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:56.208981 1488 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:44451; Asking this server to re-register.
I20260621 02:41:56.210541 1037 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:56.212270 1488 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:56.218272 800 catalog_manager.cc:2148] created HMS catalog entry for table [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:41:56.225649 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 19) took 1453 ms. Trace:
I20260621 02:41:56.225834 800 rpcz_store.cc:276] 0621 02:41:54.772458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:54.847999 (+ 75541us) service_pool.cc:227] Handling call
0621 02:41:56.141127 (+1293128us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:56.141649 (+ 522us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:56.218215 (+ 76566us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:56.225330 (+ 7115us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:56.225484 (+ 154us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:56.225601 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.219108 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.219250 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.219257 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:56.219259 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:56.219374 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.219389 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.219395 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.219490 (+ 95us) tablet.cc:699] Row locks acquired
0621 02:41:56.219492 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:56.219535 (+ 43us) write_op.cc:270] Start()
0621 02:41:56.219576 (+ 41us) write_op.cc:276] Timestamp: P: 1782009716219432 usec, L: 0
0621 02:41:56.219580 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.219819 (+ 239us) log.cc:842] Serialized 432 byte log entry
0621 02:41:56.224246 (+ 4427us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.224636 (+ 390us) write_op.cc:301] APPLY: starting
0621 02:41:56.224656 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.224706 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.224731 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.224889 (+ 158us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.224928 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:56.224934 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:56.225030 (+ 96us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.225112 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.225137 (+ 25us) write_op.cc:454] Released schema lock
0621 02:41:56.225144 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.225208 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.225211 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":34,"Hive Metastore.run_cpu_time_us":327,"Hive Metastore.run_wall_time_us":76171,"child_traces":[["op",{"apply.queue_time_us":314,"apply.run_cpu_time_us":640,"apply.run_wall_time_us":640,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":841,"prepare.run_wall_time_us":841,"raft.queue_time_us":1327,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":270,"replication_time_us":4639}]]}
I20260621 02:41:56.227813 800 catalog_manager.cc:5495] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:56.232339 1488 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:51545; Asking this server to re-register.
I20260621 02:41:56.233347 1175 heartbeater.cc:464] Registering TS with master...
I20260621 02:41:56.235400 1489 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
W20260621 02:41:56.238399 800 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.3:47833 (request call id 6) took 819 ms (client timeout 1000 ms). Trace:
W20260621 02:41:56.238529 800 rpcz_store.cc:269] 0621 02:41:55.418467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.226471 (+808004us) service_pool.cc:227] Handling call
0621 02:41:56.238305 (+ 11834us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.229078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.229199 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.229206 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:56.229208 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:56.229341 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.229387 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.229392 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0621 02:41:56.229462 (+ 70us) tablet.cc:699] Row locks acquired
0621 02:41:56.229465 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:56.229513 (+ 48us) write_op.cc:270] Start()
0621 02:41:56.229548 (+ 35us) write_op.cc:276] Timestamp: P: 1782009716229409 usec, L: 0
0621 02:41:56.229552 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.229756 (+ 204us) log.cc:842] Serialized 523 byte log entry
0621 02:41:56.236818 (+ 7062us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.237079 (+ 261us) write_op.cc:301] APPLY: starting
0621 02:41:56.237097 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.237142 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.237189 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.237247 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.237283 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.237288 (+ 5us) write_op.cc:312] APPLY: finished
0621 02:41:56.237397 (+ 109us) log.cc:842] Serialized 22 byte log entry
0621 02:41:56.237466 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.237490 (+ 24us) write_op.cc:454] Released schema lock
0621 02:41:56.237497 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.237558 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.237561 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":199,"apply.run_cpu_time_us":540,"apply.run_wall_time_us":540,"num_ops":1,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":781,"prepare.run_wall_time_us":782,"raft.queue_time_us":498,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":8,"replication_time_us":7241}]]}
I20260621 02:41:56.248381 969 tablet_service.cc:1467] Processing CreateTablet for tablet 8d871d5f864449d3bf7551e46c912549 (DEFAULT_TABLE table=default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.248872 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d871d5f864449d3bf7551e46c912549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.251024 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 8d871d5f864449d3bf7551e46c912549 (DEFAULT_TABLE table=default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.251506 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d871d5f864449d3bf7551e46c912549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.253756 1472 consensus_queue.cc:1035] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.255095 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 8d871d5f864449d3bf7551e46c912549 (DEFAULT_TABLE table=default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.254967 800 catalog_manager.cc:5495] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.255483 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d871d5f864449d3bf7551e46c912549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.255528 800 catalog_manager.cc:5495] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.255882 800 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.256166 800 catalog_manager.cc:5495] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.256575 800 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:56.260855 1430 consensus_queue.cc:1035] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.270363 1556 consensus_queue.cc:1035] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260621 02:41:56.280648 800 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.2:48795 (request call id 9) took 850 ms (client timeout 1000 ms). Trace:
W20260621 02:41:56.280807 800 rpcz_store.cc:269] 0621 02:41:55.430030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.239209 (+809179us) service_pool.cc:227] Handling call
0621 02:41:56.242726 (+ 3517us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x615000033024. stack: 00007f88c22e166e 00007f88c22e1430 00007f88c13685ed 00000000008ea064 00000000008ea02d 00007f88d09fa27d 00007f88d09fa373 00007f88cd81c361 00007f88d518f66a 00007f88d5311d8f 00007f88cc606946 00007f88cc606675 00007f88c8e1d9be 00007f88c8e1c79e 00007f88c8e22b25 00007f88c8e2354f
0621 02:41:56.280604 (+ 37878us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.274585 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.274771 (+ 186us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.274782 (+ 11us) write_op.cc:435] Acquired schema lock
0621 02:41:56.274786 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:56.275024 (+ 238us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.275045 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.275053 (+ 8us) tablet.cc:683] Acquiring locks for 3 operations
0621 02:41:56.275203 (+ 150us) tablet.cc:699] Row locks acquired
0621 02:41:56.275207 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:56.275258 (+ 51us) write_op.cc:270] Start()
0621 02:41:56.275309 (+ 51us) write_op.cc:276] Timestamp: P: 1782009716275141 usec, L: 0
0621 02:41:56.275315 (+ 6us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.275662 (+ 347us) log.cc:842] Serialized 1265 byte log entry
0621 02:41:56.279175 (+ 3513us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.279266 (+ 91us) write_op.cc:301] APPLY: starting
0621 02:41:56.279287 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.279389 (+ 102us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.279428 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.279511 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.279548 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0621 02:41:56.279554 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:56.279686 (+ 132us) log.cc:842] Serialized 34 byte log entry
0621 02:41:56.279756 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.279779 (+ 23us) write_op.cc:454] Released schema lock
0621 02:41:56.279787 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.279850 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.279854 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":6992768,"child_traces":[["op",{"apply.queue_time_us":28,"apply.run_cpu_time_us":643,"apply.run_wall_time_us":643,"num_ops":3,"prepare.queue_time_us":17202,"prepare.run_cpu_time_us":1279,"prepare.run_wall_time_us":1831,"raft.queue_time_us":88,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":393,"replication_time_us":3826}]]}
I20260621 02:41:56.281963 1567 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.282456 800 catalog_manager.cc:5495] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1). New cstate: current_term: 1 leader_uuid: "35b23c9f06314e4abf6d8aff8989e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:56.283775 1567 tablet_bootstrap.cc:654] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
W20260621 02:41:56.297148 800 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.97.1:36081 (request call id 12) took 835 ms (client timeout 1000 ms). Trace:
W20260621 02:41:56.297411 800 rpcz_store.cc:269] 0621 02:41:55.461585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.281463 (+819878us) service_pool.cc:227] Handling call
0621 02:41:56.297079 (+ 15616us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.288050 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.288212 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.288222 (+ 10us) write_op.cc:435] Acquired schema lock
0621 02:41:56.288226 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:56.288373 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.290015 (+ 1642us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.290026 (+ 11us) tablet.cc:683] Acquiring locks for 1 operations
0621 02:41:56.290146 (+ 120us) tablet.cc:699] Row locks acquired
0621 02:41:56.290151 (+ 5us) write_op.cc:260] PREPARE: finished
0621 02:41:56.290206 (+ 55us) write_op.cc:270] Start()
0621 02:41:56.290258 (+ 52us) write_op.cc:276] Timestamp: P: 1782009716290085 usec, L: 0
0621 02:41:56.290264 (+ 6us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.290536 (+ 272us) log.cc:842] Serialized 523 byte log entry
0621 02:41:56.294402 (+ 3866us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.296031 (+ 1629us) write_op.cc:301] APPLY: starting
0621 02:41:56.296055 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.296112 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.296147 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.296335 (+ 188us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.296384 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.296394 (+ 10us) write_op.cc:312] APPLY: finished
0621 02:41:56.296511 (+ 117us) log.cc:842] Serialized 22 byte log entry
0621 02:41:56.296591 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.296617 (+ 26us) write_op.cc:454] Released schema lock
0621 02:41:56.296624 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.296685 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.296688 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":1559,"apply.run_cpu_time_us":717,"apply.run_wall_time_us":715,"num_ops":1,"prepare.queue_time_us":4573,"prepare.run_cpu_time_us":1022,"prepare.run_wall_time_us":2622,"raft.queue_time_us":1174,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":293,"replication_time_us":4089}]]}
I20260621 02:41:56.301451 800 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:56.305982 1556 consensus_queue.cc:1035] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.313663 1393 consensus_queue.cc:1035] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.314872 1564 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.302146 800 catalog_manager.cc:5495] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.319759 800 catalog_manager.cc:5495] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:56.330137 1568 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.334860 1568 tablet_bootstrap.cc:654] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.336725 1393 consensus_queue.cc:1035] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.344954 800 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf] alter complete (version 1)
I20260621 02:41:56.345432 1544 tablet.cc:1722] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.347067 800 catalog_manager.cc:5495] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1). New cstate: current_term: 1 leader_uuid: "35b23c9f06314e4abf6d8aff8989e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:56.347711 800 catalog_manager.cc:5495] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1). New cstate: current_term: 1 leader_uuid: "35b23c9f06314e4abf6d8aff8989e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:56.348220 800 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:56.357648 1542 tablet.cc:1722] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.359136 1543 tablet.cc:1722] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.366380 1542 tablet.cc:1722] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.367765 800 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:56.372509 1544 tablet.cc:1722] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.376550 1564 tablet_bootstrap.cc:654] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.383356 800 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.390738 1543 tablet.cc:1722] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.394309 1564 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.394658 1564 ts_tablet_manager.cc:1397] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.008s
I20260621 02:41:56.395875 1564 raft_consensus.cc:348] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.396430 1564 raft_consensus.cc:374] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.396588 1564 raft_consensus.cc:729] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.396934 1564 consensus_queue.cc:260] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.397854 1564 ts_tablet_manager.cc:1428] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260621 02:41:56.416654 800 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.420434 1567 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.420611 1567 ts_tablet_manager.cc:1397] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.013s
I20260621 02:41:56.421473 1567 raft_consensus.cc:348] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.421763 1567 raft_consensus.cc:374] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.421868 1567 raft_consensus.cc:729] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.424290 1567 consensus_queue.cc:260] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.424878 800 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee] alter complete (version 1)
I20260621 02:41:56.429621 1567 ts_tablet_manager.cc:1428] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260621 02:41:56.436213 800 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af] alter complete (version 1)
I20260621 02:41:56.439986 1435 consensus_queue.cc:1035] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.473258 1568 tablet_bootstrap.cc:492] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.473450 1568 ts_tablet_manager.cc:1397] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.143s user 0.046s sys 0.049s
I20260621 02:41:56.474267 1568 raft_consensus.cc:348] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.474568 1568 raft_consensus.cc:374] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.474673 1568 raft_consensus.cc:729] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.474920 1568 consensus_queue.cc:260] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.475745 1568 ts_tablet_manager.cc:1428] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:56.491263 794 catalog_manager.cc:3411] renamed table default.table_3a8f206132a04b65a848c29145dfc1a9 [id=bd3fc7490a614e80a2e2a65e5f17a38c] in HMS: new name default.table_3a337887b0124960a4309bf3ff5d2ed5
I20260621 02:41:56.503027 1556 consensus_queue.cc:1035] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260621 02:41:56.510820 800 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_db696663f6f14d8cb1c0aee6f43c48a7" } modify_external_catalogs: true
I20260621 02:41:56.511184 800 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_db696663f6f14d8cb1c0aee6f43c48a7" } modify_external_catalogs: true
I20260621 02:41:56.542196 1536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:56.542649 1536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:56.556330 792 catalog_manager.cc:2148] created HMS catalog entry for table [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:41:56.558804 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:56.559106 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:56.569303 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 21) took 1761 ms. Trace:
I20260621 02:41:56.569470 792 rpcz_store.cc:276] 0621 02:41:54.808313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:55.081531 (+273218us) service_pool.cc:227] Handling call
0621 02:41:56.144568 (+1063037us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:56.145064 (+ 496us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:56.556295 (+411231us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:56.569022 (+ 12727us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:56.569136 (+ 114us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:56.569237 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.557085 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.557193 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.557199 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:56.557202 (+ 3us) tablet.cc:660] Decoding operations
0621 02:41:56.557277 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.557289 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.557294 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.557404 (+ 110us) tablet.cc:699] Row locks acquired
0621 02:41:56.557406 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:56.557443 (+ 37us) write_op.cc:270] Start()
0621 02:41:56.557474 (+ 31us) write_op.cc:276] Timestamp: P: 1782009716557372 usec, L: 0
0621 02:41:56.557477 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.557663 (+ 186us) log.cc:842] Serialized 432 byte log entry
0621 02:41:56.565065 (+ 7402us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.565161 (+ 96us) write_op.cc:301] APPLY: starting
0621 02:41:56.565175 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.565217 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.565253 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.565376 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.565410 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:56.565416 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:56.565505 (+ 89us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.565567 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.565587 (+ 20us) write_op.cc:454] Released schema lock
0621 02:41:56.565595 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.565641 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.565645 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":345853,"Hive Metastore.run_cpu_time_us":287,"Hive Metastore.run_wall_time_us":65059,"child_traces":[["op",{"apply.queue_time_us":55,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":526,"num_ops":2,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":688,"prepare.run_wall_time_us":688,"raft.queue_time_us":1372,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":399,"replication_time_us":7562,"threads_started":1}]]}
I20260621 02:41:56.571945 792 master_service.cc:946] ReplaceTablet: received request to replace tablet 8dc0581f165c4a46a59516c65f820f19 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:56.585654 969 tablet_service.cc:1467] Processing CreateTablet for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (DEFAULT_TABLE table=default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.585860 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (DEFAULT_TABLE table=default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.586143 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.586314 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.592118 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (DEFAULT_TABLE table=default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.592584 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.596101 1564 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.585193 792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 8dc0581f165c4a46a59516c65f820f19
I20260621 02:41:56.598205 1564 tablet_bootstrap.cc:654] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.598425 792 catalog_manager.cc:6565] ReplaceTablet: tablet 8dc0581f165c4a46a59516c65f820f19 deleted and replaced by tablet cd534990473b46eda79b629c9475d1e2
I20260621 02:41:56.598564 792 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 27) took 1557 ms. Trace:
I20260621 02:41:56.598667 792 rpcz_store.cc:276] 0621 02:41:55.041400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.571843 (+1530443us) service_pool.cc:227] Handling call
0621 02:41:56.598531 (+ 26688us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.575306 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.575391 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.575396 (+ 5us) write_op.cc:435] Acquired schema lock
0621 02:41:56.575398 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:56.575539 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.575553 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.575561 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.575658 (+ 97us) tablet.cc:699] Row locks acquired
0621 02:41:56.575662 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:56.575700 (+ 38us) write_op.cc:270] Start()
0621 02:41:56.575736 (+ 36us) write_op.cc:276] Timestamp: P: 1782009716575625 usec, L: 0
0621 02:41:56.575742 (+ 6us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.576012 (+ 270us) log.cc:842] Serialized 652 byte log entry
0621 02:41:56.583253 (+ 7241us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.583997 (+ 744us) write_op.cc:301] APPLY: starting
0621 02:41:56.584007 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.584036 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.584056 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.584161 (+ 105us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.584212 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.584218 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:56.584282 (+ 64us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.584343 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.584361 (+ 18us) write_op.cc:454] Released schema lock
0621 02:41:56.584366 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.584419 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.584422 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":714,"apply.run_cpu_time_us":468,"apply.run_wall_time_us":469,"num_ops":2,"prepare.queue_time_us":2356,"prepare.run_cpu_time_us":1494,"prepare.run_wall_time_us":7085,"raft.queue_time_us":1779,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":7497,"thread_start_us":20508,"threads_started":2}]]}
I20260621 02:41:56.600128 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc0581f165c4a46a59516c65f820f19 with delete_type TABLET_DATA_DELETED (replaced by tablet cd534990473b46eda79b629c9475d1e2) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:56.600988 1107 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc0581f165c4a46a59516c65f820f19 with delete_type TABLET_DATA_DELETED (replaced by tablet cd534990473b46eda79b629c9475d1e2) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:56.603387 1243 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc0581f165c4a46a59516c65f820f19 with delete_type TABLET_DATA_DELETED (replaced by tablet cd534990473b46eda79b629c9475d1e2) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:56.606383 1568 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.606405 1567 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.608167 1567 tablet_bootstrap.cc:654] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.608170 792 master_service.cc:946] ReplaceTablet: received request to replace tablet 2744c12c288144ccb6e00446fd53aeae from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:56.608682 1568 tablet_bootstrap.cc:654] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.609822 1564 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.609995 1564 ts_tablet_manager.cc:1397] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.004s
I20260621 02:41:56.610769 1564 raft_consensus.cc:348] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.611017 1564 raft_consensus.cc:374] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.611096 1564 raft_consensus.cc:729] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.611357 1564 consensus_queue.cc:260] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.613770 1564 ts_tablet_manager.cc:1428] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260621 02:41:56.617914 1242 tablet_service.cc:1467] Processing CreateTablet for tablet cd534990473b46eda79b629c9475d1e2 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.619213 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd534990473b46eda79b629c9475d1e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.620844 1109 tablet_service.cc:1467] Processing CreateTablet for tablet cd534990473b46eda79b629c9475d1e2 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.622113 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd534990473b46eda79b629c9475d1e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.627014 1592 tablet_replica.cc:330] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:56.626995 969 tablet_service.cc:1467] Processing CreateTablet for tablet cd534990473b46eda79b629c9475d1e2 (DEFAULT_TABLE table=default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.627306 1592 raft_consensus.cc:2229] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.627625 1592 raft_consensus.cc:2258] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.634644 1393 consensus_queue.cc:1035] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.638001 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd534990473b46eda79b629c9475d1e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.638451 1568 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.638696 1568 ts_tablet_manager.cc:1397] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260621 02:41:56.631071 1567 tablet_bootstrap.cc:492] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.639123 1567 ts_tablet_manager.cc:1397] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.000s
I20260621 02:41:56.639722 1568 raft_consensus.cc:348] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.640014 1568 raft_consensus.cc:374] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.640105 1568 raft_consensus.cc:729] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.640496 1567 raft_consensus.cc:348] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.640874 1593 tablet_replica.cc:330] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:56.640899 1567 raft_consensus.cc:374] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.641021 1567 raft_consensus.cc:729] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.641315 1593 raft_consensus.cc:2229] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:56.641390 1567 consensus_queue.cc:260] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.642280 1568 consensus_queue.cc:260] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.645928 792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 2744c12c288144ccb6e00446fd53aeae
I20260621 02:41:56.646229 1568 ts_tablet_manager.cc:1428] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260621 02:41:56.643123 1593 raft_consensus.cc:2258] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.647212 1241 tablet_service.cc:1514] Processing DeleteTablet for tablet 2744c12c288144ccb6e00446fd53aeae with delete_type TABLET_DATA_DELETED (replaced by tablet c8e6eed9c51943bb81997aa8c4d880eb) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:56.647330 970 tablet_service.cc:1514] Processing DeleteTablet for tablet 2744c12c288144ccb6e00446fd53aeae with delete_type TABLET_DATA_DELETED (replaced by tablet c8e6eed9c51943bb81997aa8c4d880eb) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:56.647717 1472 consensus_queue.cc:1035] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.648217 1591 tablet_replica.cc:330] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:56.648425 1591 raft_consensus.cc:2229] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.648674 1591 raft_consensus.cc:2258] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.652132 792 catalog_manager.cc:6565] ReplaceTablet: tablet 2744c12c288144ccb6e00446fd53aeae deleted and replaced by tablet c8e6eed9c51943bb81997aa8c4d880eb
I20260621 02:41:56.652138 1107 tablet_service.cc:1514] Processing DeleteTablet for tablet 2744c12c288144ccb6e00446fd53aeae with delete_type TABLET_DATA_DELETED (replaced by tablet c8e6eed9c51943bb81997aa8c4d880eb) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:56.652305 792 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 28) took 1609 ms. Trace:
I20260621 02:41:56.654528 1591 ts_tablet_manager.cc:1905] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.652400 792 rpcz_store.cc:276] 0621 02:41:55.042591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.608096 (+1565505us) service_pool.cc:227] Handling call
0621 02:41:56.652244 (+ 44148us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.628314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.628425 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.628433 (+ 8us) write_op.cc:435] Acquired schema lock
0621 02:41:56.628435 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:56.628564 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.628579 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.628584 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.628670 (+ 86us) tablet.cc:699] Row locks acquired
0621 02:41:56.628672 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:56.628717 (+ 45us) write_op.cc:270] Start()
0621 02:41:56.628756 (+ 39us) write_op.cc:276] Timestamp: P: 1782009716628631 usec, L: 0
0621 02:41:56.628760 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.629001 (+ 241us) log.cc:842] Serialized 652 byte log entry
0621 02:41:56.634582 (+ 5581us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.634680 (+ 98us) write_op.cc:301] APPLY: starting
0621 02:41:56.634697 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.634744 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.634779 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.634899 (+ 120us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.634951 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.634960 (+ 9us) write_op.cc:312] APPLY: finished
0621 02:41:56.635046 (+ 86us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.635112 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.635137 (+ 25us) write_op.cc:454] Released schema lock
0621 02:41:56.635145 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.635212 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.635216 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":33,"apply.run_cpu_time_us":590,"apply.run_wall_time_us":590,"num_ops":2,"prepare.queue_time_us":19062,"prepare.run_cpu_time_us":814,"prepare.run_wall_time_us":1252,"raft.queue_time_us":358,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":527,"replication_time_us":5787}]]}
I20260621 02:41:56.656662 1567 ts_tablet_manager.cc:1428] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260621 02:41:56.660106 970 tablet_service.cc:1467] Processing CreateTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.660409 1107 tablet_service.cc:1467] Processing CreateTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.660977 1107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e6eed9c51943bb81997aa8c4d880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.661689 1241 tablet_service.cc:1467] Processing CreateTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.662096 1241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e6eed9c51943bb81997aa8c4d880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.665925 970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e6eed9c51943bb81997aa8c4d880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.667109 1593 ts_tablet_manager.cc:1905] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.667689 1564 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.668610 1568 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.669335 1564 tablet_bootstrap.cc:654] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.670228 1568 tablet_bootstrap.cc:654] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.673873 1567 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.675648 1567 tablet_bootstrap.cc:654] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.688810 1452 raft_consensus.cc:482] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:56.689030 1452 raft_consensus.cc:504] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.685241 1592 ts_tablet_manager.cc:1905] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.689745 1452 leader_election.cc:288] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:56.690321 1593 ts_tablet_manager.cc:1918] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:56.690487 1593 log.cc:1196] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/8dc0581f165c4a46a59516c65f820f19
I20260621 02:41:56.690635 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475e1e2bcc3d4ac9a6cd03b78f737b66" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:56.690897 1127 raft_consensus.cc:2454] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:56.691004 1593 ts_tablet_manager.cc:1939] T 8dc0581f165c4a46a59516c65f820f19 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:56.691344 1198 leader_election.cc:302] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:56.691666 1452 raft_consensus.cc:2781] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:56.691756 1452 raft_consensus.cc:482] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:56.691855 1452 raft_consensus.cc:3037] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.693029 1593 tablet_replica.cc:330] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:56.692970 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 8dc0581f165c4a46a59516c65f820f19 (table default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:56.693264 1593 raft_consensus.cc:2229] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:56.693671 1593 raft_consensus.cc:2258] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.694584 1593 ts_tablet_manager.cc:1905] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.694666 1452 raft_consensus.cc:504] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.695961 1452 leader_election.cc:288] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:56.696038 792 master_service.cc:946] ReplaceTablet: received request to replace tablet 2540f7a8633748fdb8c43f8156e99ccf from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:56.696250 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475e1e2bcc3d4ac9a6cd03b78f737b66" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:56.696476 1127 raft_consensus.cc:3037] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.702172 1593 ts_tablet_manager.cc:1918] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.702461 1593 log.cc:1196] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/2744c12c288144ccb6e00446fd53aeae
I20260621 02:41:56.703177 1127 raft_consensus.cc:2454] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:56.703665 1198 leader_election.cc:302] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:56.704696 1452 raft_consensus.cc:2781] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:56.705654 1452 raft_consensus.cc:686] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:56.705849 1592 ts_tablet_manager.cc:1918] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:56.705972 1452 consensus_queue.cc:237] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.706655 792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 2540f7a8633748fdb8c43f8156e99ccf
I20260621 02:41:56.707463 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf with delete_type TABLET_DATA_DELETED (replaced by tablet 08a8a4507edf43faac392c2ac70e852f) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:56.702991 1593 ts_tablet_manager.cc:1939] T 2744c12c288144ccb6e00446fd53aeae P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:56.707686 792 catalog_manager.cc:6565] ReplaceTablet: tablet 2540f7a8633748fdb8c43f8156e99ccf deleted and replaced by tablet 08a8a4507edf43faac392c2ac70e852f
I20260621 02:41:56.707991 792 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 29) took 1657 ms. Trace:
I20260621 02:41:56.707692 1568 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.708755 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 2744c12c288144ccb6e00446fd53aeae (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]) successfully deleted
I20260621 02:41:56.708807 1568 ts_tablet_manager.cc:1397] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.005s
I20260621 02:41:56.708159 792 rpcz_store.cc:276] 0621 02:41:55.050486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.695946 (+1645460us) service_pool.cc:227] Handling call
0621 02:41:56.707942 (+ 11996us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.697553 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.697683 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.697689 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:56.697690 (+ 1us) tablet.cc:660] Decoding operations
0621 02:41:56.697793 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.697808 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.697811 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.697880 (+ 69us) tablet.cc:699] Row locks acquired
0621 02:41:56.697882 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:56.697913 (+ 31us) write_op.cc:270] Start()
0621 02:41:56.697942 (+ 29us) write_op.cc:276] Timestamp: P: 1782009716697817 usec, L: 0
0621 02:41:56.697945 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.698196 (+ 251us) log.cc:842] Serialized 652 byte log entry
0621 02:41:56.705422 (+ 7226us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.705533 (+ 111us) write_op.cc:301] APPLY: starting
0621 02:41:56.705551 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.705608 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.705638 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.705753 (+ 115us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.705825 (+ 72us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.705831 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:56.705920 (+ 89us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.705988 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.706015 (+ 27us) write_op.cc:454] Released schema lock
0621 02:41:56.706023 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.706082 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.706085 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":605,"apply.run_wall_time_us":604,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":761,"prepare.run_wall_time_us":761,"raft.queue_time_us":1529,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":518,"replication_time_us":7449}]]}
I20260621 02:41:56.709545 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf with delete_type TABLET_DATA_DELETED (replaced by tablet 08a8a4507edf43faac392c2ac70e852f) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:56.709602 1568 raft_consensus.cc:348] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.709810 1568 raft_consensus.cc:374] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.709908 1568 raft_consensus.cc:729] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.710183 1568 consensus_queue.cc:260] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.710850 1568 ts_tablet_manager.cc:1428] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:56.711122 1568 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.712435 1592 log.cc:1196] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/8dc0581f165c4a46a59516c65f820f19
I20260621 02:41:56.712461 1593 tablet_replica.cc:330] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:56.712636 1593 raft_consensus.cc:2229] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.712860 1593 raft_consensus.cc:2258] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.713263 1592 ts_tablet_manager.cc:1939] T 8dc0581f165c4a46a59516c65f820f19 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:56.714445 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 8dc0581f165c4a46a59516c65f820f19 (table default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:56.714771 1568 tablet_bootstrap.cc:654] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.714789 1592 tablet_replica.cc:330] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:56.715091 1592 raft_consensus.cc:2229] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.715785 1592 raft_consensus.cc:2258] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.716693 1593 ts_tablet_manager.cc:1905] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.717620 970 tablet_service.cc:1514] Processing DeleteTablet for tablet 2540f7a8633748fdb8c43f8156e99ccf with delete_type TABLET_DATA_DELETED (replaced by tablet 08a8a4507edf43faac392c2ac70e852f) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:56.718142 1472 consensus_queue.cc:1035] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.719053 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475e1e2bcc3d4ac9a6cd03b78f737b66" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:56.720667 989 raft_consensus.cc:2454] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:56.720949 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "475e1e2bcc3d4ac9a6cd03b78f737b66" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:56.722245 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 08a8a4507edf43faac392c2ac70e852f (DEFAULT_TABLE table=default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.722414 988 raft_consensus.cc:3037] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.722766 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a8a4507edf43faac392c2ac70e852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.725054 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 08a8a4507edf43faac392c2ac70e852f (DEFAULT_TABLE table=default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.725530 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a8a4507edf43faac392c2ac70e852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.727437 969 tablet_service.cc:1467] Processing CreateTablet for tablet 08a8a4507edf43faac392c2ac70e852f (DEFAULT_TABLE table=default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.727803 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a8a4507edf43faac392c2ac70e852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.736536 1591 ts_tablet_manager.cc:1918] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:56.736704 1591 log.cc:1196] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/8dc0581f165c4a46a59516c65f820f19
I20260621 02:41:56.737120 1591 ts_tablet_manager.cc:1939] T 8dc0581f165c4a46a59516c65f820f19 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:56.737193 988 raft_consensus.cc:2454] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:56.746559 1392 consensus_queue.cc:1035] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.762147 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 8dc0581f165c4a46a59516c65f820f19 (table default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:56.763569 1592 ts_tablet_manager.cc:1905] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.764132 1591 tablet_replica.cc:330] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:56.764385 1591 raft_consensus.cc:2229] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.767057 1472 consensus_queue.cc:1035] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.768947 1591 raft_consensus.cc:2258] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.770288 1591 ts_tablet_manager.cc:1905] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.775468 792 catalog_manager.cc:5495] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.778276 1564 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.778522 1564 ts_tablet_manager.cc:1397] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.111s user 0.025s sys 0.027s
I20260621 02:41:56.779386 1564 raft_consensus.cc:348] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.779899 1593 ts_tablet_manager.cc:1918] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.781072 1593 log.cc:1196] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/2540f7a8633748fdb8c43f8156e99ccf
I20260621 02:41:56.781514 1564 raft_consensus.cc:374] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.781663 1564 raft_consensus.cc:729] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.782424 1564 consensus_queue.cc:260] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.783082 1564 ts_tablet_manager.cc:1428] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260621 02:41:56.784917 1567 tablet_bootstrap.cc:492] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.785104 1567 ts_tablet_manager.cc:1397] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.111s user 0.004s sys 0.007s
I20260621 02:41:56.785745 1593 ts_tablet_manager.cc:1939] T 2540f7a8633748fdb8c43f8156e99ccf P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:56.785887 1567 raft_consensus.cc:348] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.786118 1567 raft_consensus.cc:374] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.786199 1567 raft_consensus.cc:729] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.786454 1567 consensus_queue.cc:260] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.787156 1567 ts_tablet_manager.cc:1428] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:56.787427 1567 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.791190 1564 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.791375 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:56.795142 1567 tablet_bootstrap.cc:654] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.796096 1568 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.796330 1568 ts_tablet_manager.cc:1397] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.085s user 0.005s sys 0.008s
I20260621 02:41:56.797204 1568 raft_consensus.cc:348] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.797542 1568 raft_consensus.cc:374] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.797667 1568 raft_consensus.cc:729] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.797986 1568 consensus_queue.cc:260] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.798974 1592 ts_tablet_manager.cc:1918] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.799127 1592 log.cc:1196] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/2744c12c288144ccb6e00446fd53aeae
I20260621 02:41:56.799530 1592 ts_tablet_manager.cc:1939] T 2744c12c288144ccb6e00446fd53aeae P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:56.799862 1591 ts_tablet_manager.cc:1918] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.800000 1591 log.cc:1196] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/2744c12c288144ccb6e00446fd53aeae
I20260621 02:41:56.804724 1564 tablet_bootstrap.cc:654] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.805979 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 2744c12c288144ccb6e00446fd53aeae (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]) successfully deleted
I20260621 02:41:56.807816 1591 ts_tablet_manager.cc:1939] T 2744c12c288144ccb6e00446fd53aeae P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:56.808368 1592 tablet_replica.cc:330] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:56.808557 1592 raft_consensus.cc:2229] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:56.809106 1592 raft_consensus.cc:2258] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.809909 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 2744c12c288144ccb6e00446fd53aeae (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]) successfully deleted
I20260621 02:41:56.811412 1568 ts_tablet_manager.cc:1428] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260621 02:41:56.811439 1591 tablet_replica.cc:330] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:56.812713 1564 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.812794 1592 ts_tablet_manager.cc:1905] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.813062 1564 ts_tablet_manager.cc:1397] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260621 02:41:56.814200 1564 raft_consensus.cc:348] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.814553 1564 raft_consensus.cc:374] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.814687 1564 raft_consensus.cc:729] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.815018 1564 consensus_queue.cc:260] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.816864 1568 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.816902 792 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]). Expected version 1 got 0
I20260621 02:41:56.819782 1564 ts_tablet_manager.cc:1428] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260621 02:41:56.819953 1568 tablet_bootstrap.cc:654] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.820312 1591 raft_consensus.cc:2229] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260621 02:41:56.823035 792 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c8e6eed9c51943bb81997aa8c4d880eb consensus state has no leader
I20260621 02:41:56.824683 1564 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.825001 1591 raft_consensus.cc:2258] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.827651 792 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]). Expected version 1 got 0
I20260621 02:41:56.822516 1383 consensus_queue.cc:1035] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.822331 1567 tablet_bootstrap.cc:492] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.828426 1567 ts_tablet_manager.cc:1397] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.006s
I20260621 02:41:56.829421 1567 raft_consensus.cc:348] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.829695 1567 raft_consensus.cc:374] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.829794 1567 raft_consensus.cc:729] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.830041 1567 consensus_queue.cc:260] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.830583 1567 ts_tablet_manager.cc:1428] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260621 02:41:56.830890 1567 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.833426 1591 ts_tablet_manager.cc:1905] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.833626 1567 tablet_bootstrap.cc:654] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.827741 1564 tablet_bootstrap.cc:654] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.829178 1592 ts_tablet_manager.cc:1918] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.840876 1592 log.cc:1196] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/2540f7a8633748fdb8c43f8156e99ccf
I20260621 02:41:56.841456 1592 ts_tablet_manager.cc:1939] T 2540f7a8633748fdb8c43f8156e99ccf P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:56.843554 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:56.846091 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]). Expected version 1 got 0
I20260621 02:41:56.847896 792 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]). Expected version 1 got 0
I20260621 02:41:56.849304 1567 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.849526 1567 ts_tablet_manager.cc:1397] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.002s
I20260621 02:41:56.850355 1567 raft_consensus.cc:348] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.850898 1567 raft_consensus.cc:374] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.851003 1567 raft_consensus.cc:729] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.851320 1567 consensus_queue.cc:260] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.855894 1567 ts_tablet_manager.cc:1428] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260621 02:41:56.857622 1568 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.857802 1568 ts_tablet_manager.cc:1397] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.007s
I20260621 02:41:56.859745 1564 tablet_bootstrap.cc:492] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.860330 1564 ts_tablet_manager.cc:1397] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260621 02:41:56.860373 1568 raft_consensus.cc:348] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.860621 1568 raft_consensus.cc:374] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.861086 1564 raft_consensus.cc:348] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.861318 1564 raft_consensus.cc:374] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.861445 1564 raft_consensus.cc:729] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.861480 1568 raft_consensus.cc:729] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.861471 1591 ts_tablet_manager.cc:1918] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.861773 1591 log.cc:1196] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/2540f7a8633748fdb8c43f8156e99ccf
I20260621 02:41:56.861730 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.861760 1564 consensus_queue.cc:260] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.861784 1568 consensus_queue.cc:260] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.862435 1568 ts_tablet_manager.cc:1428] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260621 02:41:56.863816 1564 ts_tablet_manager.cc:1428] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260621 02:41:56.864405 792 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 08a8a4507edf43faac392c2ac70e852f consensus state has no leader
I20260621 02:41:56.865571 792 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.867059 792 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.867645 792 master_service.cc:946] ReplaceTablet: received request to replace tablet 0603aaa2e9b94ea48c859c08018055e5 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:56.871227 1591 ts_tablet_manager.cc:1939] T 2540f7a8633748fdb8c43f8156e99ccf P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:56.872784 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 2540f7a8633748fdb8c43f8156e99ccf (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:41:56.877431 792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 0603aaa2e9b94ea48c859c08018055e5
I20260621 02:41:56.878784 969 tablet_service.cc:1514] Processing DeleteTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 260404e813714081b78847d874de6c38) from {username='slave'} at 127.0.0.1:49528
I20260621 02:41:56.878971 792 catalog_manager.cc:6565] ReplaceTablet: tablet 0603aaa2e9b94ea48c859c08018055e5 deleted and replaced by tablet 260404e813714081b78847d874de6c38
I20260621 02:41:56.879134 792 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 30) took 1824 ms. Trace:
I20260621 02:41:56.879195 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 260404e813714081b78847d874de6c38) from {username='slave'} at 127.0.0.1:35408
I20260621 02:41:56.879479 1592 tablet_replica.cc:330] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:56.879698 1592 raft_consensus.cc:2229] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:56.879222 792 rpcz_store.cc:276] 0621 02:41:55.054453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.867576 (+1813123us) service_pool.cc:227] Handling call
0621 02:41:56.879074 (+ 11498us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:56.868750 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:56.868887 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:56.868894 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:56.868898 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:56.869024 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:56.869039 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:56.869045 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:56.869137 (+ 92us) tablet.cc:699] Row locks acquired
0621 02:41:56.869140 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:56.869182 (+ 42us) write_op.cc:270] Start()
0621 02:41:56.869220 (+ 38us) write_op.cc:276] Timestamp: P: 1782009716869151 usec, L: 0
0621 02:41:56.869224 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:56.869445 (+ 221us) log.cc:842] Serialized 652 byte log entry
0621 02:41:56.876195 (+ 6750us) op_driver.cc:444] REPLICATION: finished
0621 02:41:56.876328 (+ 133us) write_op.cc:301] APPLY: starting
0621 02:41:56.876347 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:56.876396 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:56.876428 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:56.876565 (+ 137us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:56.876644 (+ 79us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:56.876656 (+ 12us) write_op.cc:312] APPLY: finished
0621 02:41:56.876776 (+ 120us) log.cc:842] Serialized 28 byte log entry
0621 02:41:56.876850 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.876880 (+ 30us) write_op.cc:454] Released schema lock
0621 02:41:56.876889 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:56.876961 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:56.876968 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":38,"apply.run_cpu_time_us":707,"apply.run_wall_time_us":708,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":828,"prepare.run_wall_time_us":828,"raft.queue_time_us":940,"raft.run_cpu_time_us":670,"raft.run_wall_time_us":1953,"replication_time_us":6935}]]}
I20260621 02:41:56.880437 1592 raft_consensus.cc:2258] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.881500 1591 tablet_replica.cc:330] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:56.881738 1591 raft_consensus.cc:2229] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.881945 1591 raft_consensus.cc:2258] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.881999 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet 0603aaa2e9b94ea48c859c08018055e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 260404e813714081b78847d874de6c38) from {username='slave'} at 127.0.0.1:38742
I20260621 02:41:56.882362 1593 tablet_replica.cc:330] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:56.882923 1592 ts_tablet_manager.cc:1905] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.882983 1591 ts_tablet_manager.cc:1905] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.885586 1593 raft_consensus.cc:2229] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:56.885818 1593 raft_consensus.cc:2258] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:56.887158 1593 ts_tablet_manager.cc:1905] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:56.889428 1592 ts_tablet_manager.cc:1918] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.889444 1591 ts_tablet_manager.cc:1918] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.889596 1592 log.cc:1196] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/0603aaa2e9b94ea48c859c08018055e5
I20260621 02:41:56.889597 1591 log.cc:1196] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/0603aaa2e9b94ea48c859c08018055e5
I20260621 02:41:56.889890 793 catalog_manager.cc:3411] renamed table default.table_6edd16d2d48f4b57a8f4f99ec6043589 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5] in HMS: new name default.table_faabbcd5060949a29d7f5c57526fb922
I20260621 02:41:56.890005 1592 ts_tablet_manager.cc:1939] T 0603aaa2e9b94ea48c859c08018055e5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:56.890363 1591 ts_tablet_manager.cc:1939] T 0603aaa2e9b94ea48c859c08018055e5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:56.891146 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:56.891451 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:56.896095 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.896481 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 260404e813714081b78847d874de6c38 (DEFAULT_TABLE table=default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.896914 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260404e813714081b78847d874de6c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.897504 792 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.897872 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 260404e813714081b78847d874de6c38 (DEFAULT_TABLE table=default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.898294 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260404e813714081b78847d874de6c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.898963 969 tablet_service.cc:1467] Processing CreateTablet for tablet 260404e813714081b78847d874de6c38 (DEFAULT_TABLE table=default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:56.899344 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260404e813714081b78847d874de6c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:56.906567 1568 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:56.908293 1568 tablet_bootstrap.cc:654] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.909302 1564 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:56.911109 1564 tablet_bootstrap.cc:654] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.920993 792 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.923008 1619 tablet.cc:1722] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.923643 1593 ts_tablet_manager.cc:1918] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:56.923834 1593 log.cc:1196] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/0603aaa2e9b94ea48c859c08018055e5
I20260621 02:41:56.924263 1593 ts_tablet_manager.cc:1939] T 0603aaa2e9b94ea48c859c08018055e5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:56.924943 1617 tablet.cc:1722] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.925822 1616 tablet.cc:1722] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:56.926072 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 3dac6c7a546048d6ae29186f789ca188 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
I20260621 02:41:56.927356 1452 raft_consensus.cc:482] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:56.926321 1567 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:56.927631 1568 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:56.927531 1452 raft_consensus.cc:504] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.927774 1568 ts_tablet_manager.cc:1397] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260621 02:41:56.928241 1452 leader_election.cc:288] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:56.928397 792 master_service.cc:946] ReplaceTablet: received request to replace tablet 2744c12c288144ccb6e00446fd53aeae from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:56.928795 792 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 31) took 1848 ms. Trace:
I20260621 02:41:56.929904 1567 tablet_bootstrap.cc:654] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:56.930477 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a8a4507edf43faac392c2ac70e852f" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:56.930718 988 raft_consensus.cc:2454] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:56.931121 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a8a4507edf43faac392c2ac70e852f" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:56.931344 1127 raft_consensus.cc:2454] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:56.931811 1198 leader_election.cc:302] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:56.932525 1452 raft_consensus.cc:2781] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:56.932642 1452 raft_consensus.cc:482] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:56.932718 1452 raft_consensus.cc:3037] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.935451 1452 raft_consensus.cc:504] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.936647 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a8a4507edf43faac392c2ac70e852f" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:56.936990 988 raft_consensus.cc:3037] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.938046 1567 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:56.938211 1567 ts_tablet_manager.cc:1397] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260621 02:41:56.939045 1567 raft_consensus.cc:348] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.939288 1567 raft_consensus.cc:374] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.939373 1567 raft_consensus.cc:729] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.939608 1567 consensus_queue.cc:260] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.940536 988 raft_consensus.cc:2454] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:56.941339 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08a8a4507edf43faac392c2ac70e852f" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:56.941592 1127 raft_consensus.cc:3037] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.947547 1452 leader_election.cc:288] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:56.948096 1196 leader_election.cc:302] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:56.948506 1393 raft_consensus.cc:2781] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:56.948630 1393 raft_consensus.cc:686] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:56.948882 1393 consensus_queue.cc:237] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.942407 1567 ts_tablet_manager.cc:1428] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260621 02:41:56.951138 792 rpcz_store.cc:276] 0621 02:41:55.080055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.926693 (+1846638us) service_pool.cc:227] Handling call
0621 02:41:56.928763 (+ 2070us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:56.951275 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 0603aaa2e9b94ea48c859c08018055e5 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]) successfully deleted
I20260621 02:41:56.952420 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
W20260621 02:41:56.954120 792 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 260404e813714081b78847d874de6c38 consensus state has no leader
I20260621 02:41:56.945837 1127 raft_consensus.cc:2454] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:56.953677 1564 tablet_bootstrap.cc:492] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:56.964838 792 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c] alter complete (version 1)
I20260621 02:41:56.968662 1564 ts_tablet_manager.cc:1397] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.008s
I20260621 02:41:56.968945 1452 consensus_queue.cc:1035] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.970052 792 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:56.970496 1568 raft_consensus.cc:348] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.970929 1568 raft_consensus.cc:374] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:56.971050 1568 raft_consensus.cc:729] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:56.971321 1568 consensus_queue.cc:260] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.971903 1568 ts_tablet_manager.cc:1428] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.044s user 0.001s sys 0.000s
I20260621 02:41:56.975667 1392 consensus_queue.cc:1035] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:56.981104 792 catalog_manager.cc:5495] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:56.981678 792 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:56.982051 1556 raft_consensus.cc:482] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:56.982247 1556 raft_consensus.cc:504] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.982901 1556 leader_election.cc:288] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:56.984788 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d871d5f864449d3bf7551e46c912549" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:56.985067 1261 raft_consensus.cc:2454] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:56.985749 1065 leader_election.cc:302] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:56.986081 1556 raft_consensus.cc:2781] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:56.986213 1556 raft_consensus.cc:482] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:56.986325 1556 raft_consensus.cc:3037] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.986305 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d871d5f864449d3bf7551e46c912549" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:56.986634 989 raft_consensus.cc:2454] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:56.992473 792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_d1ef4b80062944b2b46fb4b28a26a746" } modify_external_catalogs: true
I20260621 02:41:56.992769 792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_d1ef4b80062944b2b46fb4b28a26a746" } modify_external_catalogs: true
I20260621 02:41:56.993782 1556 raft_consensus.cc:504] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:56.997502 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d871d5f864449d3bf7551e46c912549" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:56.997777 989 raft_consensus.cc:3037] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:56.998021 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d871d5f864449d3bf7551e46c912549" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:56.998253 1261 raft_consensus.cc:3037] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.001498 989 raft_consensus.cc:2454] T 8d871d5f864449d3bf7551e46c912549 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.002197 1062 leader_election.cc:302] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:57.002516 1557 raft_consensus.cc:2781] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:56.992591 1564 raft_consensus.cc:348] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.007493 1564 raft_consensus.cc:374] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.007601 1564 raft_consensus.cc:729] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.009641 1564 consensus_queue.cc:260] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
W20260621 02:41:57.011416 874 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
W20260621 02:41:57.013118 791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4e260ee413ad41378c547ad6650740fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:57.016677 1261 raft_consensus.cc:2454] T 8d871d5f864449d3bf7551e46c912549 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.019349 1556 leader_election.cc:288] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.027005 1557 raft_consensus.cc:686] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:57.038203 1564 ts_tablet_manager.cc:1428] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.069s user 0.001s sys 0.001s
W20260621 02:41:57.038239 798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a150263b166249fa86e82c610ad9270b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:57.038810 797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7316d10767b943a3972b1a92374e24c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:57.040346 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47520 (request call id 11) took 2467 ms. Trace:
I20260621 02:41:57.040485 799 rpcz_store.cc:276] 0621 02:41:54.572411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:54.572475 (+ 64us) service_pool.cc:227] Handling call
0621 02:41:55.210720 (+638245us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.039696 (+1828976us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.040023 (+ 327us) catalog_manager.cc:3616] Apply alter schema
0621 02:41:57.040302 (+ 279us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":55082,"Hive Metastore.run_cpu_time_us":1177,"Hive Metastore.run_wall_time_us":577731}
I20260621 02:41:57.042418 799 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:57.046977 1127 raft_consensus.cc:1261] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Refusing update from remote peer a2d4d8ec6f9845f5bbfca1390740aedc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.047313 989 raft_consensus.cc:1261] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Refusing update from remote peer a2d4d8ec6f9845f5bbfca1390740aedc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.047807 1393 consensus_queue.cc:1035] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.048378 1393 consensus_queue.cc:1035] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.053081 1557 consensus_queue.cc:237] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.049252 799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_377281571f164709ac6324086e74e1a5" } modify_external_catalogs: true
I20260621 02:41:57.054828 799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_377281571f164709ac6324086e74e1a5" } modify_external_catalogs: true
I20260621 02:41:57.051486 796 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47520 (request call id 12) took 2448 ms. Trace:
I20260621 02:41:57.058557 796 rpcz_store.cc:276] 0621 02:41:54.603229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:54.603317 (+ 88us) service_pool.cc:227] Handling call
0621 02:41:55.211117 (+607800us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.050857 (+1839740us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.051129 (+ 272us) catalog_manager.cc:3616] Apply alter schema
0621 02:41:57.051442 (+ 313us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":632613,"Hive Metastore.run_cpu_time_us":792,"Hive Metastore.run_wall_time_us":139858}
I20260621 02:41:57.060357 796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_73d184c634e44e4fa7308cc8ce9305fc" } modify_external_catalogs: true
I20260621 02:41:57.060595 796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_73d184c634e44e4fa7308cc8ce9305fc" } modify_external_catalogs: true
I20260621 02:41:57.052079 795 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47520 (request call id 13) took 2401 ms. Trace:
I20260621 02:41:57.061138 795 rpcz_store.cc:276] 0621 02:41:54.650541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:54.650592 (+ 51us) service_pool.cc:227] Handling call
0621 02:41:55.211388 (+560796us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.051557 (+1840169us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.051819 (+ 262us) catalog_manager.cc:3616] Apply alter schema
0621 02:41:57.052029 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":765411,"Hive Metastore.run_cpu_time_us":1171,"Hive Metastore.run_wall_time_us":109370}
I20260621 02:41:57.063364 795 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:57.063661 795 catalog_manager.cc:5495] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:57.071637 795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_608c53f32c054ee49c55bcf8ee3a7e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:57.082647 1617 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.083215 791 catalog_manager.cc:2148] created HMS catalog entry for table [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:41:57.083206 1557 raft_consensus.cc:482] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.083371 1557 raft_consensus.cc:504] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.083959 1557 leader_election.cc:288] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.085186 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e6eed9c51943bb81997aa8c4d880eb" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:57.086401 1450 mvcc.cc:205] Tried to move back new op lower bound from 7299111801016803328 to 7299111800625385472. Current Snapshot: MvccSnapshot[applied={T|T < 7299111801016803328}]
I20260621 02:41:57.086808 1261 raft_consensus.cc:2454] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.087054 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e6eed9c51943bb81997aa8c4d880eb" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:57.087296 989 raft_consensus.cc:2454] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.088059 1065 leader_election.cc:302] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.090585 1454 mvcc.cc:205] Tried to move back new op lower bound from 7299111801016803328 to 7299111800625385472. Current Snapshot: MvccSnapshot[applied={T|T < 7299111801016803328}]
I20260621 02:41:57.091140 1616 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.091687 1625 raft_consensus.cc:2781] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.091823 1625 raft_consensus.cc:482] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.091868 1619 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.091979 1625 raft_consensus.cc:3037] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.095118 1625 raft_consensus.cc:504] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.095847 1625 leader_election.cc:288] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.096400 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e6eed9c51943bb81997aa8c4d880eb" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:57.100709 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 23) took 2250 ms. Trace:
I20260621 02:41:57.100831 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e6eed9c51943bb81997aa8c4d880eb" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:57.101058 1261 raft_consensus.cc:3037] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.100834 791 rpcz_store.cc:276] 0621 02:41:54.850438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:55.390742 (+540304us) service_pool.cc:227] Handling call
0621 02:41:57.013257 (+1622515us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:57.013765 (+ 508us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:57.083175 (+ 69410us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:57.100422 (+ 17247us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:57.100545 (+ 123us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:57.100646 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:57.087776 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:57.087891 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:57.087898 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:57.087901 (+ 3us) tablet.cc:660] Decoding operations
0621 02:41:57.088000 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:57.088015 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:57.088020 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:57.088128 (+ 108us) tablet.cc:699] Row locks acquired
0621 02:41:57.088132 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:57.088172 (+ 40us) write_op.cc:270] Start()
0621 02:41:57.088207 (+ 35us) write_op.cc:276] Timestamp: P: 1782009717088097 usec, L: 0
0621 02:41:57.088211 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:57.088413 (+ 202us) log.cc:842] Serialized 432 byte log entry
0621 02:41:57.098106 (+ 9693us) op_driver.cc:444] REPLICATION: finished
0621 02:41:57.098231 (+ 125us) write_op.cc:301] APPLY: starting
0621 02:41:57.098249 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:57.098295 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:57.098328 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:57.098445 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:57.098481 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:57.098488 (+ 7us) write_op.cc:312] APPLY: finished
0621 02:41:57.098574 (+ 86us) log.cc:842] Serialized 28 byte log entry
0621 02:41:57.098645 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.098669 (+ 24us) write_op.cc:454] Released schema lock
0621 02:41:57.098677 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:57.098734 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.098738 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":44,"Hive Metastore.run_cpu_time_us":278,"Hive Metastore.run_wall_time_us":69123,"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":567,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":3983,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":746,"raft.queue_time_us":73,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":226,"replication_time_us":9871}]]}
I20260621 02:41:57.099138 989 raft_consensus.cc:3037] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.102463 791 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:57.103847 791 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]). Expected version 1 got 0
I20260621 02:41:57.104779 989 raft_consensus.cc:2454] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.106009 1062 leader_election.cc:302] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:57.106853 1625 raft_consensus.cc:2781] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.107014 1261 raft_consensus.cc:2454] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.107384 1625 raft_consensus.cc:686] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:57.107700 1625 consensus_queue.cc:237] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.116387 791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_3548a6e62b27484d8fa771f8688ca8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:57.117516 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 67321be37d724469b620707de07c7f03 (DEFAULT_TABLE table=default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.117646 969 tablet_service.cc:1467] Processing CreateTablet for tablet 67321be37d724469b620707de07c7f03 (DEFAULT_TABLE table=default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.117885 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67321be37d724469b620707de07c7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.118187 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67321be37d724469b620707de07c7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.122637 1242 tablet_service.cc:1467] Processing CreateTablet for tablet 67321be37d724469b620707de07c7f03 (DEFAULT_TABLE table=default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.123098 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67321be37d724469b620707de07c7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.123184 1564 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:57.125427 1564 tablet_bootstrap.cc:654] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.128419 1567 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:57.130191 1567 tablet_bootstrap.cc:654] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.138470 1568 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:57.140654 1568 tablet_bootstrap.cc:654] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.143049 1564 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:57.143222 1564 ts_tablet_manager.cc:1397] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
I20260621 02:41:57.144551 1564 raft_consensus.cc:348] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.144788 1564 raft_consensus.cc:374] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.144891 1564 raft_consensus.cc:729] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.145999 1564 consensus_queue.cc:260] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.147095 1625 raft_consensus.cc:482] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.147246 1625 raft_consensus.cc:504] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.147899 1625 leader_election.cc:288] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.147951 1564 ts_tablet_manager.cc:1428] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260621 02:41:57.150966 798 catalog_manager.cc:2148] created HMS catalog entry for table [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:41:57.151957 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260404e813714081b78847d874de6c38" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:57.152252 1261 raft_consensus.cc:2454] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.152321 1567 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:57.152462 1567 ts_tablet_manager.cc:1397] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.005s
I20260621 02:41:57.153400 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260404e813714081b78847d874de6c38" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:57.153538 1065 leader_election.cc:302] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.153642 989 raft_consensus.cc:2454] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.157004 1567 raft_consensus.cc:348] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.157334 1567 raft_consensus.cc:374] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.157524 1567 raft_consensus.cc:729] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.157827 1567 consensus_queue.cc:260] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.157969 1625 raft_consensus.cc:2781] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.158099 1625 raft_consensus.cc:482] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.158185 1625 raft_consensus.cc:3037] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.158299 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 24) took 2178 ms. Trace:
I20260621 02:41:57.158404 798 rpcz_store.cc:276] 0621 02:41:54.979759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:55.410529 (+430770us) service_pool.cc:227] Handling call
0621 02:41:57.038356 (+1627827us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:57.038905 (+ 549us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:57.150932 (+112027us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:57.158011 (+ 7079us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:57.158140 (+ 129us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:57.158235 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:57.151691 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:57.151810 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:57.151816 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:57.151818 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:57.151909 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:57.151924 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:57.151929 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:57.152010 (+ 81us) tablet.cc:699] Row locks acquired
0621 02:41:57.152013 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:57.152051 (+ 38us) write_op.cc:270] Start()
0621 02:41:57.152086 (+ 35us) write_op.cc:276] Timestamp: P: 1782009717151963 usec, L: 0
0621 02:41:57.152090 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:57.152267 (+ 177us) log.cc:842] Serialized 432 byte log entry
0621 02:41:57.157191 (+ 4924us) op_driver.cc:444] REPLICATION: finished
0621 02:41:57.157322 (+ 131us) write_op.cc:301] APPLY: starting
0621 02:41:57.157344 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:57.157451 (+ 107us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:57.157485 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:57.157645 (+ 160us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:57.157699 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:57.157710 (+ 11us) write_op.cc:312] APPLY: finished
0621 02:41:57.157812 (+ 102us) log.cc:842] Serialized 28 byte log entry
0621 02:41:57.157889 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.157918 (+ 29us) write_op.cc:454] Released schema lock
0621 02:41:57.157928 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:57.157992 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.157995 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":44035,"Hive Metastore.run_cpu_time_us":274,"Hive Metastore.run_wall_time_us":67550,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":719,"apply.run_wall_time_us":719,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":688,"prepare.run_wall_time_us":688,"raft.queue_time_us":1137,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":345,"replication_time_us":5070}]]}
I20260621 02:41:57.160983 1567 ts_tablet_manager.cc:1428] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260621 02:41:57.162170 1625 raft_consensus.cc:504] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.163374 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260404e813714081b78847d874de6c38" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:57.163581 989 raft_consensus.cc:3037] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.166134 989 raft_consensus.cc:2454] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.166787 1062 leader_election.cc:302] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:57.167371 1557 raft_consensus.cc:2781] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.167517 1557 raft_consensus.cc:686] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:57.167760 1557 consensus_queue.cc:237] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.170047 1625 leader_election.cc:288] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.170574 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260404e813714081b78847d874de6c38" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:57.170826 1261 raft_consensus.cc:3037] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.171701 1568 tablet_bootstrap.cc:492] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:57.171846 1568 ts_tablet_manager.cc:1397] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.009s
I20260621 02:41:57.172699 1568 raft_consensus.cc:348] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.172924 1568 raft_consensus.cc:374] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.173030 1568 raft_consensus.cc:729] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.173307 1568 consensus_queue.cc:260] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.173921 1568 ts_tablet_manager.cc:1428] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:57.179298 798 catalog_manager.cc:5495] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:57.179837 798 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]). Expected version 1 got 0
I20260621 02:41:57.180891 1109 tablet_service.cc:1467] Processing CreateTablet for tablet a50603036c5046e8aba135c3787f890a (DEFAULT_TABLE table=default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.181013 969 tablet_service.cc:1467] Processing CreateTablet for tablet a50603036c5046e8aba135c3787f890a (DEFAULT_TABLE table=default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.181452 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50603036c5046e8aba135c3787f890a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.181468 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50603036c5046e8aba135c3787f890a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260621 02:41:57.187712 786 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
I20260621 02:41:57.187487 1261 raft_consensus.cc:2454] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.187901 1564 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:57.189679 1564 tablet_bootstrap.cc:654] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.189952 1242 tablet_service.cc:1467] Processing CreateTablet for tablet a50603036c5046e8aba135c3787f890a (DEFAULT_TABLE table=default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.190454 1242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50603036c5046e8aba135c3787f890a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.211364 798 catalog_manager.cc:5495] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:57.212016 798 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]). Expected version 1 got 0
I20260621 02:41:57.215153 1564 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:57.215441 1564 ts_tablet_manager.cc:1397] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
I20260621 02:41:57.216352 1564 raft_consensus.cc:348] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.216678 1564 raft_consensus.cc:374] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.216804 1564 raft_consensus.cc:729] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.217123 1564 consensus_queue.cc:260] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.217928 1564 ts_tablet_manager.cc:1428] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260621 02:41:57.221968 798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_5ca503a3c4ba46a6bda089bf52d0f837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:57.225529 1555 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:41:57.225674 1555 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: loading cluster ID for follower catalog manager: success
I20260621 02:41:57.226372 797 catalog_manager.cc:2148] created HMS catalog entry for table [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:41:57.231395 1555 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: acquiring CA information for follower catalog manager: success
I20260621 02:41:57.234723 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 25) took 2203 ms. Trace:
I20260621 02:41:57.234892 797 rpcz_store.cc:276] 0621 02:41:55.031756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:55.413159 (+381403us) service_pool.cc:227] Handling call
0621 02:41:57.038922 (+1625763us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:57.039356 (+ 434us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:57.226310 (+186954us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:57.234461 (+ 8151us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:57.234579 (+ 118us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:57.234680 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:57.227021 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:57.227154 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:57.227160 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:57.227162 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:57.227245 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:57.227259 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:57.227263 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:57.227345 (+ 82us) tablet.cc:699] Row locks acquired
0621 02:41:57.227349 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:57.227384 (+ 35us) write_op.cc:270] Start()
0621 02:41:57.227422 (+ 38us) write_op.cc:276] Timestamp: P: 1782009717227282 usec, L: 0
0621 02:41:57.227425 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:57.227594 (+ 169us) log.cc:842] Serialized 432 byte log entry
0621 02:41:57.233687 (+ 6093us) op_driver.cc:444] REPLICATION: finished
0621 02:41:57.233824 (+ 137us) write_op.cc:301] APPLY: starting
0621 02:41:57.233840 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:57.233889 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:57.233925 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:57.234037 (+ 112us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:57.234088 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:57.234098 (+ 10us) write_op.cc:312] APPLY: finished
0621 02:41:57.234189 (+ 91us) log.cc:842] Serialized 28 byte log entry
0621 02:41:57.234262 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.234284 (+ 22us) write_op.cc:454] Released schema lock
0621 02:41:57.234291 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:57.234348 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:57.234351 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":111254,"Hive Metastore.run_cpu_time_us":273,"Hive Metastore.run_wall_time_us":75426,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":580,"apply.run_wall_time_us":579,"num_ops":2,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":672,"prepare.run_wall_time_us":672,"raft.queue_time_us":176,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":355,"replication_time_us":6234,"spinlock_wait_cycles":189696}]]}
I20260621 02:41:57.235641 1555 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:41:57.238806 1567 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:57.240626 1567 tablet_bootstrap.cc:654] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.245558 797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_d92b84136868428790cb79925c3f1a33" } modify_external_catalogs: true
I20260621 02:41:57.245821 797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47520:
table { table_name: "default.Table_d92b84136868428790cb79925c3f1a33" } modify_external_catalogs: true
I20260621 02:41:57.247763 1241 tablet_service.cc:1467] Processing CreateTablet for tablet fb30ab4457aa45858a6e722be50eb43b (DEFAULT_TABLE table=default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.247834 1109 tablet_service.cc:1467] Processing CreateTablet for tablet fb30ab4457aa45858a6e722be50eb43b (DEFAULT_TABLE table=default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.248193 1241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb30ab4457aa45858a6e722be50eb43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.248296 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb30ab4457aa45858a6e722be50eb43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.256578 1564 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:57.256762 1568 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:57.257257 969 tablet_service.cc:1467] Processing CreateTablet for tablet fb30ab4457aa45858a6e722be50eb43b (DEFAULT_TABLE table=default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:57.258325 1564 tablet_bootstrap.cc:654] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.258363 1568 tablet_bootstrap.cc:654] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.257740 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb30ab4457aa45858a6e722be50eb43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:57.272670 1567 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:57.272890 1567 ts_tablet_manager.cc:1397] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.007s
I20260621 02:41:57.273881 1564 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:57.273904 1567 raft_consensus.cc:348] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.274159 1567 raft_consensus.cc:374] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.274197 1564 ts_tablet_manager.cc:1397] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.003s
I20260621 02:41:57.274250 1567 raft_consensus.cc:729] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.274276 1568 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:57.274456 1568 ts_tablet_manager.cc:1397] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.007s
I20260621 02:41:57.274523 1567 consensus_queue.cc:260] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.275283 1567 ts_tablet_manager.cc:1428] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:57.275270 1568 raft_consensus.cc:348] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.275509 1568 raft_consensus.cc:374] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.275596 1568 raft_consensus.cc:729] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.275857 1567 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:57.275866 1568 consensus_queue.cc:260] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.277426 1564 raft_consensus.cc:348] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.277863 1564 raft_consensus.cc:374] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.278057 1564 raft_consensus.cc:729] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.278960 1568 ts_tablet_manager.cc:1428] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260621 02:41:57.279084 1567 tablet_bootstrap.cc:654] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.279309 1568 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:57.281910 1568 tablet_bootstrap.cc:654] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:57.283386 1564 consensus_queue.cc:260] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.288251 1568 tablet_bootstrap.cc:492] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:57.288414 1568 ts_tablet_manager.cc:1397] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260621 02:41:57.289269 1568 raft_consensus.cc:348] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.289537 1568 raft_consensus.cc:374] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.289645 1568 raft_consensus.cc:729] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.289861 1568 consensus_queue.cc:260] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.292692 989 raft_consensus.cc:1261] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Refusing update from remote peer 6f52030a7bb641f883dba1ffbd912dba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.294214 1557 consensus_queue.cc:1035] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.294461 1568 ts_tablet_manager.cc:1428] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260621 02:41:57.294934 1261 raft_consensus.cc:1261] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Refusing update from remote peer 6f52030a7bb641f883dba1ffbd912dba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.297672 794 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47520 (request call id 20) took 2518 ms. Trace:
I20260621 02:41:57.297820 794 rpcz_store.cc:276] 0621 02:41:54.779056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:54.877025 (+ 97969us) service_pool.cc:227] Handling call
0621 02:41:56.143857 (+1266832us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.297056 (+1153199us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.297343 (+ 287us) catalog_manager.cc:3616] Apply alter schema
0621 02:41:57.297624 (+ 281us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":73978,"Hive Metastore.run_cpu_time_us":723,"Hive Metastore.run_wall_time_us":272910}
I20260621 02:41:57.298954 1557 consensus_queue.cc:1035] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.301916 793 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47520 (request call id 22) took 2471 ms. Trace:
I20260621 02:41:57.302049 793 rpcz_store.cc:276] 0621 02:41:54.830451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:55.175077 (+344626us) service_pool.cc:227] Handling call
0621 02:41:56.145314 (+970237us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.301093 (+1155779us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:57.301348 (+ 255us) catalog_manager.cc:3616] Apply alter schema
0621 02:41:57.301869 (+ 521us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":410632,"Hive Metastore.run_cpu_time_us":748,"Hive Metastore.run_wall_time_us":333667}
I20260621 02:41:57.302512 793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_6217ff360f914564a1fee8cacc9c1e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:57.302743 1567 tablet_bootstrap.cc:492] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:57.302914 1567 ts_tablet_manager.cc:1397] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.014s
I20260621 02:41:57.304054 1567 raft_consensus.cc:348] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.305166 1567 raft_consensus.cc:374] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:57.305325 1567 raft_consensus.cc:729] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:57.306155 1567 consensus_queue.cc:260] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.307550 1567 ts_tablet_manager.cc:1428] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260621 02:41:57.309918 1564 ts_tablet_manager.cc:1428] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260621 02:41:57.309921 794 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_f380223331ea479893e63d4d53570bed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:57.327088 1619 tablet.cc:1722] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.327699 1451 mvcc.cc:205] Tried to move back new op lower bound from 7299111802007511040 to 7299111801521647616. Current Snapshot: MvccSnapshot[applied={T|T < 7299111802007511040}]
I20260621 02:41:57.338596 1616 tablet.cc:1722] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.355639 1617 tablet.cc:1722] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.366946 1557 raft_consensus.cc:482] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.367163 1557 raft_consensus.cc:504] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.367846 1557 leader_election.cc:288] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.368687 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67321be37d724469b620707de07c7f03" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:57.369298 1261 raft_consensus.cc:2454] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.369882 1065 leader_election.cc:302] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.370273 1557 raft_consensus.cc:2781] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.370366 1557 raft_consensus.cc:482] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.370458 1557 raft_consensus.cc:3037] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.370859 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67321be37d724469b620707de07c7f03" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:57.371117 989 raft_consensus.cc:2454] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.373283 1557 raft_consensus.cc:504] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.374723 1557 leader_election.cc:288] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.374897 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67321be37d724469b620707de07c7f03" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:57.375017 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67321be37d724469b620707de07c7f03" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:57.375170 989 raft_consensus.cc:3037] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.375321 1261 raft_consensus.cc:3037] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.378284 1261 raft_consensus.cc:2454] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.378297 989 raft_consensus.cc:2454] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.378813 1065 leader_election.cc:302] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.379209 1557 raft_consensus.cc:2781] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.379472 1557 raft_consensus.cc:686] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:57.379733 1557 consensus_queue.cc:237] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.385854 1430 raft_consensus.cc:482] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.386034 1430 raft_consensus.cc:504] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.386721 1430 leader_election.cc:288] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:57.387616 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50603036c5046e8aba135c3787f890a" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:57.387938 1126 raft_consensus.cc:2454] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:57.388391 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50603036c5046e8aba135c3787f890a" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:57.388603 926 leader_election.cc:302] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:57.388659 1261 raft_consensus.cc:2454] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:57.389026 1430 raft_consensus.cc:2781] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.389153 1430 raft_consensus.cc:482] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.389254 1430 raft_consensus.cc:3037] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.392238 1430 raft_consensus.cc:504] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.393309 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50603036c5046e8aba135c3787f890a" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:57.393451 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50603036c5046e8aba135c3787f890a" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:57.393577 1261 raft_consensus.cc:3037] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.393661 1126 raft_consensus.cc:3037] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.396587 1126 raft_consensus.cc:2454] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:57.397145 926 leader_election.cc:302] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:57.397472 1383 raft_consensus.cc:2781] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.397629 1383 raft_consensus.cc:686] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:57.397868 1383 consensus_queue.cc:237] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.400089 1430 leader_election.cc:288] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:57.404356 1261 raft_consensus.cc:2454] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:57.438043 989 raft_consensus.cc:1261] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Refusing update from remote peer 6f52030a7bb641f883dba1ffbd912dba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.438524 1261 raft_consensus.cc:1261] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Refusing update from remote peer 6f52030a7bb641f883dba1ffbd912dba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:57.438797 1556 consensus_queue.cc:1035] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.439666 1556 consensus_queue.cc:1035] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.453033 1619 tablet.cc:1722] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.453856 1616 tablet.cc:1722] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.481019 1617 tablet.cc:1722] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:57.578724 1556 raft_consensus.cc:482] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.579419 1556 raft_consensus.cc:504] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.580125 1556 leader_election.cc:288] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.581195 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd534990473b46eda79b629c9475d1e2" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:57.581297 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd534990473b46eda79b629c9475d1e2" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:57.581476 1261 raft_consensus.cc:2454] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.581547 989 raft_consensus.cc:2454] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:57.581988 1065 leader_election.cc:302] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.582417 1556 raft_consensus.cc:2781] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.582520 1556 raft_consensus.cc:482] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.582626 1556 raft_consensus.cc:3037] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.585418 1556 raft_consensus.cc:504] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.586567 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd534990473b46eda79b629c9475d1e2" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:57.586814 989 raft_consensus.cc:3037] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.586786 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd534990473b46eda79b629c9475d1e2" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:57.587001 1261 raft_consensus.cc:3037] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.589728 989 raft_consensus.cc:2454] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.589736 1261 raft_consensus.cc:2454] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:57.590250 1065 leader_election.cc:302] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.590600 1626 raft_consensus.cc:2781] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.590760 1626 raft_consensus.cc:686] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:57.591084 1626 consensus_queue.cc:237] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:57.593021 1556 leader_election.cc:288] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:57.649271 1452 raft_consensus.cc:482] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:57.649544 1452 raft_consensus.cc:504] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.650297 1452 leader_election.cc:288] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:57.651149 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb30ab4457aa45858a6e722be50eb43b" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:57.651360 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb30ab4457aa45858a6e722be50eb43b" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:57.651439 989 raft_consensus.cc:2454] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:57.651619 1126 raft_consensus.cc:2454] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:57.652099 1196 leader_election.cc:302] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.652624 1452 raft_consensus.cc:2781] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:57.652725 1452 raft_consensus.cc:482] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:57.652823 1452 raft_consensus.cc:3037] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.655701 1452 raft_consensus.cc:504] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.656739 1452 leader_election.cc:288] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:57.657217 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb30ab4457aa45858a6e722be50eb43b" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:57.657477 1126 raft_consensus.cc:3037] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.660333 1126 raft_consensus.cc:2454] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:57.660854 1198 leader_election.cc:302] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:57.661164 1452 raft_consensus.cc:2781] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:57.661329 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb30ab4457aa45858a6e722be50eb43b" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:57.661602 989 raft_consensus.cc:3037] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:57.666471 989 raft_consensus.cc:2454] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:57.681756 1452 raft_consensus.cc:686] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:57.682354 1452 consensus_queue.cc:237] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:57.682094 1651 consensus_queue.cc:1035] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260621 02:41:57.704501 1655 consensus_queue.cc:1035] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.823423 1659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:57.823823 1659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:57.826712 739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:41:57.826980 739 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 1.
I20260621 02:41:57.827653 1476 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters:
I20260621 02:41:57.834141 1660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260621 02:41:57.834342 1660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:57.834244 1658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:41:57.834664 1660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 1 FOLLOWER]: Advancing to term 2
I20260621 02:41:57.834834 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:41:57.834795 1658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:57.836115 1658 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:57.836015 1501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:41:57.836818 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:41:57.835984 1659 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:57.837421 714 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:57.838580 1658 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260621 02:41:57.846459 1660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:57.847901 739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c"
I20260621 02:41:57.848131 739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 1 FOLLOWER]: Advancing to term 2
I20260621 02:41:57.850183 1660 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 election: Requested vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:41:57.850229 810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 68 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599"
I20260621 02:41:57.851522 739 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 2.
I20260621 02:41:57.852052 1476 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters: 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:57.852959 1660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260621 02:41:57.853173 1660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 LEADER]: Becoming Leader. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Running, Role: LEADER
I20260621 02:41:57.853695 1660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 1.68, Last appended by leader: 68, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:57.856001 1659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:57.856240 1659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:57.856933 1661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:41:57.860762 1661 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:41:57.861348 1661 catalog_manager.cc:669] Loaded metadata for table default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:41:57.862267 1661 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:41:57.862829 1661 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:41:57.863296 1661 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:41:57.863847 1661 catalog_manager.cc:669] Loaded metadata for table default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:41:57.864253 1661 catalog_manager.cc:669] Loaded metadata for table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:41:57.864755 1661 catalog_manager.cc:669] Loaded metadata for table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]
I20260621 02:41:57.865175 1661 catalog_manager.cc:669] Loaded metadata for table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]
I20260621 02:41:57.865649 1661 catalog_manager.cc:669] Loaded metadata for table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]
I20260621 02:41:57.866066 1661 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:41:57.866621 1661 catalog_manager.cc:669] Loaded metadata for table default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05]
I20260621 02:41:57.867051 1661 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:41:57.867547 1661 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:41:57.867964 1661 catalog_manager.cc:669] Loaded metadata for table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]
I20260621 02:41:57.871353 1661 tablet_loader.cc:96] loaded metadata for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:41:57.871997 1661 tablet_loader.cc:96] loaded metadata for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:41:57.872593 1661 tablet_loader.cc:96] loaded metadata for tablet 3cefa90be47244babf78e52753e663d5 (table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6])
I20260621 02:41:57.872992 1661 tablet_loader.cc:96] loaded metadata for tablet 3dac6c7a546048d6ae29186f789ca188 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:41:57.873411 1661 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:41:57.873780 1661 tablet_loader.cc:96] loaded metadata for tablet 67321be37d724469b620707de07c7f03 (table default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:41:57.874153 1661 tablet_loader.cc:96] loaded metadata for tablet 750ee0afb60d44c4b6d70947edcc9096 (table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6])
I20260621 02:41:57.874779 1661 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:41:57.875376 1661 tablet_loader.cc:96] loaded metadata for tablet 97f3b4a1836740df984e0f5329267930 (table default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05])
I20260621 02:41:57.875758 1661 tablet_loader.cc:96] loaded metadata for tablet a50603036c5046e8aba135c3787f890a (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:41:57.876169 1661 tablet_loader.cc:96] loaded metadata for tablet a9ecff86eae34204a735dca560a2f85b (table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51])
I20260621 02:41:57.876617 1661 tablet_loader.cc:96] loaded metadata for tablet b21ad2c9db57446492a0329f899a1afe (table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d])
I20260621 02:41:57.877679 1661 tablet_loader.cc:96] loaded metadata for tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:41:57.878029 1661 tablet_loader.cc:96] loaded metadata for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:41:57.878680 1661 tablet_loader.cc:96] loaded metadata for tablet fb30ab4457aa45858a6e722be50eb43b (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:41:57.879024 1661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:41:57.881534 1661 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:41:57.881636 1661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:41:57.890277 739 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Rejecting Update request from peer 5d142d25b86d4ad7935e806b7ebe8599 for earlier term 1. Current term is 2. Ops: []
I20260621 02:41:57.891232 1626 consensus_queue.cc:1035] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.891795 1588 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: INVALID_TERM, Last received: 1.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 02:41:57.899287 1661 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:41:57.905416 1661 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Loaded TSK: 0
I20260621 02:41:57.906860 1661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:41:57.908843 1661 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:41:57.910830 1661 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 20
I20260621 02:41:57.946852 1487 catalog_manager.cc:5495] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1). New cstate: current_term: 1 leader_uuid: "35b23c9f06314e4abf6d8aff8989e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:57.950354 800 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]
I20260621 02:41:57.964313 1556 consensus_queue.cc:1035] T 8d871d5f864449d3bf7551e46c912549 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:57.970796 1662 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 LEADER]: Stepping down as leader of term 1
I20260621 02:41:57.970935 1662 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Running, Role: LEADER
I20260621 02:41:57.971297 1662 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 1.68, Last appended by leader: 68, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:57.971906 1662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 1 FOLLOWER]: Advancing to term 2
I20260621 02:41:58.001214 810 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Refusing update from remote peer 09161df32dff4fa18f1926765ea191d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 68. Preceding OpId from leader: term: 2 index: 70. (index mismatch)
I20260621 02:41:58.002185 1659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 02:41:58.009956 739 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Refusing update from remote peer 09161df32dff4fa18f1926765ea191d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 68. Preceding OpId from leader: term: 2 index: 70. (index mismatch)
I20260621 02:41:58.011322 1659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 02:41:58.018812 1658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.019142 1658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:58.023486 1665 mvcc.cc:205] Tried to move back new op lower bound from 7299111804922609664 to 7299111804333735936. Current Snapshot: MvccSnapshot[applied={T|T < 7299111804922609664}]
I20260621 02:41:58.025503 792 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05]
W20260621 02:41:58.027947 795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_608c53f32c054ee49c55bcf8ee3a7e46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.028378 791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3548a6e62b27484d8fa771f8688ca8af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.029044 798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5ca503a3c4ba46a6bda089bf52d0f837 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:58.037096 1662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.037380 1662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:58.037667 792 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47520 (request call id 32) took 2919 ms. Trace:
W20260621 02:41:58.037736 793 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6217ff360f914564a1fee8cacc9c1e2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:58.037801 792 rpcz_store.cc:276] 0621 02:41:55.118621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.992286 (+1873665us) service_pool.cc:227] Handling call
0621 02:41:57.302824 (+310538us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:58.037581 (+734757us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":647304,"Hive Metastore.run_cpu_time_us":242,"Hive Metastore.run_wall_time_us":75022}
I20260621 02:41:58.041463 800 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47520 (request call id 26) took 3006 ms. Trace:
I20260621 02:41:58.042138 800 rpcz_store.cc:276] 0621 02:41:55.034584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:56.510453 (+1475869us) service_pool.cc:227] Handling call
0621 02:41:57.300815 (+790362us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:58.041428 (+740613us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":12542,"Hive Metastore.run_cpu_time_us":337,"Hive Metastore.run_wall_time_us":636630}
I20260621 02:41:58.043037 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 42) took 1268 ms. Trace:
I20260621 02:41:58.043188 800 rpcz_store.cc:276] 0621 02:41:56.774882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.042442 (+1267560us) service_pool.cc:227] Handling call
0621 02:41:58.043001 (+ 559us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260621 02:41:58.044502 1315 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:39755)
W20260621 02:41:58.046058 794 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f380223331ea479893e63d4d53570bed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:58.045907 800 master_service.cc:946] ReplaceTablet: received request to replace tablet cd534990473b46eda79b629c9475d1e2 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:58.047354 800 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 43) took 1242 ms. Trace:
I20260621 02:41:58.047492 800 rpcz_store.cc:276] 0621 02:41:56.804640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.045854 (+1241214us) service_pool.cc:227] Handling call
0621 02:41:58.047298 (+ 1444us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260621 02:41:58.048554 1315 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.60:39755)
I20260621 02:41:58.049053 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 750ee0afb60d44c4b6d70947edcc9096 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:58.049573 800 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 44) took 1189 ms. Trace:
I20260621 02:41:58.049708 800 rpcz_store.cc:276] 0621 02:41:56.860121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.048964 (+1188843us) service_pool.cc:227] Handling call
0621 02:41:58.049536 (+ 572us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:58.050078 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 3dac6c7a546048d6ae29186f789ca188 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:58.050455 800 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47520 (request call id 45) took 1131 ms. Trace:
I20260621 02:41:58.050547 800 rpcz_store.cc:276] 0621 02:41:56.918814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.049998 (+1131184us) service_pool.cc:227] Handling call
0621 02:41:58.050404 (+ 406us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:58.050814 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 750ee0afb60d44c4b6d70947edcc9096 from {username='slave'} at 127.0.0.1:47520
I20260621 02:41:58.051272 800 master_service.cc:946] ReplaceTablet: received request to replace tablet 97f3b4a1836740df984e0f5329267930 from {username='slave'} at 127.0.0.1:47520
W20260621 02:41:58.052796 1315 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:39755)
I20260621 02:41:58.053411 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 41) took 1610 ms. Trace:
I20260621 02:41:58.053535 792 rpcz_store.cc:276] 0621 02:41:56.430974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.040935 (+1609961us) service_pool.cc:227] Handling call
0621 02:41:58.041339 (+ 404us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:58.055593 792 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:47534 (request call id 0) took 1808 ms. Trace:
I20260621 02:41:58.055708 792 rpcz_store.cc:276] 0621 02:41:56.246805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.055208 (+1808403us) service_pool.cc:227] Handling call
0621 02:41:58.055536 (+ 328us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:58.056246 792 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:47496 (request call id 1) took 1087 ms. Trace:
I20260621 02:41:58.056360 792 rpcz_store.cc:276] 0621 02:41:56.968798 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.055905 (+1087107us) service_pool.cc:227] Handling call
0621 02:41:58.056185 (+ 280us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260621 02:41:58.057446 766 master_runner.cc:263] No leader master found from master 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:41:58.057549 766 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:41:58.058880 1402 master_runner.cc:232] Existing masters have differing terms: 1 vs 2
I20260621 02:41:58.059120 1402 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:41:58.070032 1662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.070323 1662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:58.070480 696 master_runner.cc:232] Existing masters have differing terms: 1 vs 2
I20260621 02:41:58.070739 696 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:41:58.074026 799 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]
I20260621 02:41:58.074615 799 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47520 (request call id 33) took 2935 ms. Trace:
I20260621 02:41:58.074766 799 rpcz_store.cc:276] 0621 02:41:55.138962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.049087 (+1910125us) service_pool.cc:227] Handling call
0621 02:41:58.027703 (+978616us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:58.074574 (+ 46871us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1455,"Hive Metastore.run_cpu_time_us":295,"Hive Metastore.run_wall_time_us":44435}
I20260621 02:41:58.080901 1660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.081205 1660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:58.081600 1660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.081918 1660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:41:58.085840 1658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:58.086133 1658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:41:58.086809 1037 heartbeater.cc:503] Master 127.0.97.62:44219 was elected leader, sending a full tablet report...
I20260621 02:41:58.090399 1309 heartbeater.cc:503] Master 127.0.97.62:44219 was elected leader, sending a full tablet report...
I20260621 02:41:58.093189 1488 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:58.099987 1489 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:58.100406 1489 catalog_manager.cc:5495] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
W20260621 02:41:58.104303 1488 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
I20260621 02:41:58.119854 1488 master_service.cc:946] ReplaceTablet: received request to replace tablet cd534990473b46eda79b629c9475d1e2 from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:58.120471 1489 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "default.Table_becc7bbf75e442e3aff1f1b9b077cf00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:58.121141 1487 master_service.cc:946] ReplaceTablet: received request to replace tablet 750ee0afb60d44c4b6d70947edcc9096 from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:58.122592 1483 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_55949c61dce74206ba47a1657f192207" } new_table_name: "default.Table_9d5ad560ef6b47d1b30f5b78b7638733" modify_external_catalogs: true
I20260621 02:41:58.123348 1482 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_65a5205e941c44c5bdc59e0846793cb3" } new_table_name: "default.Table_d0753d0b484d47f691d51bf949845520" modify_external_catalogs: true
I20260621 02:41:58.121592 1486 master_service.cc:946] ReplaceTablet: received request to replace tablet 3dac6c7a546048d6ae29186f789ca188 from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:58.123880 1481 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_4e260ee413ad41378c547ad6650740fd" } new_table_name: "default.Table_5a02f30d3adf4196b07934e402f06d8e" modify_external_catalogs: true
I20260621 02:41:58.124513 1480 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "default.Table_bc5bd36243f048bba4f16b19363408e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:58.121822 1485 master_service.cc:946] ReplaceTablet: received request to replace tablet 750ee0afb60d44c4b6d70947edcc9096 from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:58.122041 1484 master_service.cc:946] ReplaceTablet: received request to replace tablet 97f3b4a1836740df984e0f5329267930 from {username='slave'} at 127.0.0.1:42094
W20260621 02:41:58.131269 1474 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
I20260621 02:41:58.135082 1553 catalog_manager.cc:2709] Deleting table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51] in response to Hive Metastore notification log event 21
I20260621 02:41:58.138854 1488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet cd534990473b46eda79b629c9475d1e2
I20260621 02:41:58.148553 796 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]
I20260621 02:41:58.155305 1488 catalog_manager.cc:6565] ReplaceTablet: tablet cd534990473b46eda79b629c9475d1e2 deleted and replaced by tablet 6f1bd2ccc74f4a3f856c56ad73602bfe
I20260621 02:41:58.165418 1487 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet 750ee0afb60d44c4b6d70947edcc9096
I20260621 02:41:58.166072 1487 catalog_manager.cc:6565] ReplaceTablet: tablet 750ee0afb60d44c4b6d70947edcc9096 deleted and replaced by tablet d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:58.170310 1486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet 3dac6c7a546048d6ae29186f789ca188
I20260621 02:41:58.170928 1486 catalog_manager.cc:6565] ReplaceTablet: tablet 3dac6c7a546048d6ae29186f789ca188 deleted and replaced by tablet 6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:58.190084 796 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47520 (request call id 34) took 2960 ms. Trace:
I20260621 02:41:58.190287 796 rpcz_store.cc:276] 0621 02:41:55.229974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.060215 (+1830241us) service_pool.cc:227] Handling call
0621 02:41:58.027920 (+967705us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:58.189990 (+162070us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":45763,"Hive Metastore.run_cpu_time_us":206,"Hive Metastore.run_wall_time_us":74437}
I20260621 02:41:58.216200 795 catalog_manager.cc:2148] created HMS catalog entry for table [id=b29c379f823c425bb8c96525bd0668da]
W20260621 02:41:58.217061 795 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER
I20260621 02:41:58.217715 1553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet a9ecff86eae34204a735dca560a2f85b
I20260621 02:41:58.216714 1486 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_faabbcd5060949a29d7f5c57526fb922" } new_table_name: "default.Table_5a92341192d44cc889170dcf2bdf23dc" modify_external_catalogs: true
I20260621 02:41:58.218880 1484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet 97f3b4a1836740df984e0f5329267930
I20260621 02:41:58.217001 1487 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "default.Table_7a5f6439abf24a988873c3d9c7d71dd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:58.215991 1485 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_7316d10767b943a3972b1a92374e24c9" } new_table_name: "default.Table_99d895f423774b16bccf9a8c0a5671fe" modify_external_catalogs: true
I20260621 02:41:58.216694 1488 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "default.Table_784797b809be4d9287f0cd76cb9e1e39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:58.221220 1484 catalog_manager.cc:6565] ReplaceTablet: tablet 97f3b4a1836740df984e0f5329267930 deleted and replaced by tablet dfd945b247c14e8388646457c1fbac00
I20260621 02:41:58.221679 1484 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42094:
name: "default.Table_750a14e723cf445bbf3e12c70742fc7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:41:58.223206 1553 catalog_manager.cc:2709] Deleting table default.table_d1ef4b80062944b2b46fb4b28a26a746 [id=89b656341812498ebe18e263aee13d05] in response to Hive Metastore notification log event 22
I20260621 02:41:58.233820 1553 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dfd945b247c14e8388646457c1fbac00
I20260621 02:41:58.240541 1553 catalog_manager.cc:2709] Deleting table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6] in response to Hive Metastore notification log event 23
I20260621 02:41:58.252329 1553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet 3cefa90be47244babf78e52753e663d5
I20260621 02:41:58.254222 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet cd534990473b46eda79b629c9475d1e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f1bd2ccc74f4a3f856c56ad73602bfe) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.254696 1241 tablet_service.cc:1514] Processing DeleteTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 with delete_type TABLET_DATA_DELETED (replaced by tablet d80d37015a6e47f39cc0b9c197f150de) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.254894 1683 tablet_replica.cc:330] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.254937 1243 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dac6c7a546048d6ae29186f789ca188 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ef4cdcf4c9e4db2a776a1b2516c0745) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.255146 1240 tablet_service.cc:1514] Processing DeleteTablet for tablet 97f3b4a1836740df984e0f5329267930 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd945b247c14e8388646457c1fbac00) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.255404 1683 raft_consensus.cc:2229] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.255429 1239 tablet_service.cc:1514] Processing DeleteTablet for tablet a9ecff86eae34204a735dca560a2f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.255693 1683 raft_consensus.cc:2258] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.256014 1238 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.256294 1683 ts_tablet_manager.cc:1905] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.256474 1238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.257226 791 catalog_manager.cc:2148] created HMS catalog entry for table [id=c8f2e71516fc4297ac8177de874b068a]
I20260621 02:41:58.257752 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260621 02:41:58.258062 791 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER
I20260621 02:41:58.258157 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.258495 1553 catalog_manager.cc:2709] Deleting table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6] in response to Hive Metastore notification log event 24
I20260621 02:41:58.261163 876 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:41:58.261766 1236 tablet_service.cc:1467] Processing CreateTablet for tablet d80d37015a6e47f39cc0b9c197f150de (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.262228 1236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d80d37015a6e47f39cc0b9c197f150de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.254240 1235 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cefa90be47244babf78e52753e663d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.268100 1683 ts_tablet_manager.cc:1918] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:58.268352 1683 log.cc:1196] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/cd534990473b46eda79b629c9475d1e2
I20260621 02:41:58.268887 1683 ts_tablet_manager.cc:1939] T cd534990473b46eda79b629c9475d1e2 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.270293 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:58.270789 1683 tablet_replica.cc:330] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.271076 1683 raft_consensus.cc:2229] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.271443 1683 raft_consensus.cc:2258] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.272213 1683 ts_tablet_manager.cc:1905] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.273551 1553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:58.275915 1242 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:58.278602 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet cd534990473b46eda79b629c9475d1e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f1bd2ccc74f4a3f856c56ad73602bfe) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.278836 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dac6c7a546048d6ae29186f789ca188 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ef4cdcf4c9e4db2a776a1b2516c0745) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.279158 1106 tablet_service.cc:1514] Processing DeleteTablet for tablet 97f3b4a1836740df984e0f5329267930 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd945b247c14e8388646457c1fbac00) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.279454 1105 tablet_service.cc:1514] Processing DeleteTablet for tablet a9ecff86eae34204a735dca560a2f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.279779 1107 tablet_service.cc:1514] Processing DeleteTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 with delete_type TABLET_DATA_DELETED (replaced by tablet d80d37015a6e47f39cc0b9c197f150de) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.279780 1103 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cefa90be47244babf78e52753e663d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.280827 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.280926 1102 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:58.281293 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.281351 1106 tablet_service.cc:1467] Processing CreateTablet for tablet d80d37015a6e47f39cc0b9c197f150de (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.281765 1106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d80d37015a6e47f39cc0b9c197f150de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.284963 1104 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.285465 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.286746 1683 ts_tablet_manager.cc:1918] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.286938 1683 log.cc:1196] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/750ee0afb60d44c4b6d70947edcc9096
I20260621 02:41:58.287443 1683 ts_tablet_manager.cc:1939] T 750ee0afb60d44c4b6d70947edcc9096 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.289217 1683 tablet_replica.cc:330] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.289510 1683 raft_consensus.cc:2229] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.289849 1683 raft_consensus.cc:2258] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.293334 1683 ts_tablet_manager.cc:1905] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260621 02:41:58.293975 1489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_becc7bbf75e442e3aff1f1b9b077cf00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.294052 1484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_750a14e723cf445bbf3e12c70742fc7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.294314 1488 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_784797b809be4d9287f0cd76cb9e1e39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.295652 1487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7a5f6439abf24a988873c3d9c7d71dd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260621 02:41:58.296550 1480 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bc5bd36243f048bba4f16b19363408e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 02:41:58.300905 1683 ts_tablet_manager.cc:1918] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:58.301169 1683 log.cc:1196] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/3dac6c7a546048d6ae29186f789ca188
I20260621 02:41:58.301977 1683 ts_tablet_manager.cc:1939] T 3dac6c7a546048d6ae29186f789ca188 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.303992 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 3dac6c7a546048d6ae29186f789ca188 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
I20260621 02:41:58.304636 1683 tablet_replica.cc:330] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.305068 1683 raft_consensus.cc:2229] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.307682 1683 raft_consensus.cc:2258] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.308454 1683 ts_tablet_manager.cc:1905] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.315451 1685 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:58.318317 1683 ts_tablet_manager.cc:1918] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.318733 1683 log.cc:1196] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/97f3b4a1836740df984e0f5329267930
I20260621 02:41:58.319437 1683 ts_tablet_manager.cc:1939] T 97f3b4a1836740df984e0f5329267930 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.321096 1683 tablet_replica.cc:330] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.321470 1683 raft_consensus.cc:2229] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.321810 1683 raft_consensus.cc:2258] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.322594 1683 ts_tablet_manager.cc:1905] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.325923 1686 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:58.327981 1686 tablet_bootstrap.cc:654] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.332050 1683 ts_tablet_manager.cc:1918] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.340967 1685 tablet_bootstrap.cc:654] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.341856 1683 log.cc:1196] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/a9ecff86eae34204a735dca560a2f85b
I20260621 02:41:58.351917 1683 ts_tablet_manager.cc:1939] T a9ecff86eae34204a735dca560a2f85b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.352494 1684 tablet_replica.cc:330] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.352741 1684 raft_consensus.cc:2229] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.353390 1684 pending_rounds.cc:62] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Trying to abort 1 pending ops.
I20260621 02:41:58.353617 1684 pending_rounds.cc:68] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299111803255562240 op_type: NO_OP noop_request { }
I20260621 02:41:58.353967 1684 raft_consensus.cc:2866] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260621 02:41:58.354205 1684 raft_consensus.cc:2258] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.354530 969 tablet_service.cc:1514] Processing DeleteTablet for tablet cd534990473b46eda79b629c9475d1e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f1bd2ccc74f4a3f856c56ad73602bfe) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.354909 970 tablet_service.cc:1514] Processing DeleteTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 with delete_type TABLET_DATA_DELETED (replaced by tablet d80d37015a6e47f39cc0b9c197f150de) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.355160 971 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dac6c7a546048d6ae29186f789ca188 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ef4cdcf4c9e4db2a776a1b2516c0745) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.355437 968 tablet_service.cc:1514] Processing DeleteTablet for tablet 97f3b4a1836740df984e0f5329267930 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd945b247c14e8388646457c1fbac00) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.355669 967 tablet_service.cc:1514] Processing DeleteTablet for tablet a9ecff86eae34204a735dca560a2f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.355875 1684 ts_tablet_manager.cc:1905] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.356178 966 tablet_service.cc:1467] Processing CreateTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.356348 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet a9ecff86eae34204a735dca560a2f85b (table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]) successfully deleted
I20260621 02:41:58.356621 966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.356701 1683 tablet_replica.cc:330] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:58.356983 1683 raft_consensus.cc:2229] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.357344 1683 raft_consensus.cc:2258] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.358026 1683 ts_tablet_manager.cc:1905] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.359309 1686 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:58.359506 1686 ts_tablet_manager.cc:1397] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.009s
I20260621 02:41:58.360494 1686 raft_consensus.cc:348] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.360595 965 tablet_service.cc:1467] Processing CreateTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.360864 1686 raft_consensus.cc:374] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.360993 965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.361006 1686 raft_consensus.cc:729] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.361388 1686 consensus_queue.cc:260] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.363056 1686 ts_tablet_manager.cc:1428] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260621 02:41:58.364890 1686 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:58.365764 964 tablet_service.cc:1467] Processing CreateTablet for tablet d80d37015a6e47f39cc0b9c197f150de (DEFAULT_TABLE table=default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:58.366173 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d80d37015a6e47f39cc0b9c197f150de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:58.368070 1686 tablet_bootstrap.cc:654] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.369225 963 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cefa90be47244babf78e52753e663d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.369608 1683 ts_tablet_manager.cc:1918] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.369757 1683 log.cc:1196] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/3cefa90be47244babf78e52753e663d5
I20260621 02:41:58.369963 962 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:58.370177 1683 ts_tablet_manager.cc:1939] T 3cefa90be47244babf78e52753e663d5 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:58.371248 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 3cefa90be47244babf78e52753e663d5 (table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]) successfully deleted
W20260621 02:41:58.372249 1476 catalog_manager.cc:4821] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): delete failed for tablet d80d37015a6e47f39cc0b9c197f150de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d80d37015a6e47f39cc0b9c197f150de already in progress: creating tablet
I20260621 02:41:58.373034 1684 ts_tablet_manager.cc:1918] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.373238 1684 log.cc:1196] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/cd534990473b46eda79b629c9475d1e2
I20260621 02:41:58.373824 1684 ts_tablet_manager.cc:1939] T cd534990473b46eda79b629c9475d1e2 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.384989 1685 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:58.385560 1685 ts_tablet_manager.cc:1397] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.003s
I20260621 02:41:58.386423 1685 raft_consensus.cc:348] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.386703 1685 raft_consensus.cc:374] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.386797 1685 raft_consensus.cc:729] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.387025 1685 consensus_queue.cc:260] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.387513 1690 tablet_replica.cc:330] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.387567 1685 ts_tablet_manager.cc:1428] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260621 02:41:58.387766 1690 raft_consensus.cc:2229] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.388046 1690 raft_consensus.cc:2258] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.388631 1690 ts_tablet_manager.cc:1905] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.388862 1175 heartbeater.cc:503] Master 127.0.97.62:44219 was elected leader, sending a full tablet report...
I20260621 02:41:58.391145 1685 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:58.392830 1685 tablet_bootstrap.cc:654] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.410533 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:58.411337 1684 tablet_replica.cc:330] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.411872 1684 raft_consensus.cc:2229] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.412434 1684 raft_consensus.cc:2258] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.413318 1684 ts_tablet_manager.cc:1905] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.419369 1690 ts_tablet_manager.cc:1918] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:58.422240 1685 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:58.422595 1685 ts_tablet_manager.cc:1397] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.003s
I20260621 02:41:58.423805 1685 raft_consensus.cc:348] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.424247 1685 raft_consensus.cc:374] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.424410 1685 raft_consensus.cc:729] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.424853 1685 consensus_queue.cc:260] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.429168 1690 log.cc:1196] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/cd534990473b46eda79b629c9475d1e2
I20260621 02:41:58.430377 1690 ts_tablet_manager.cc:1939] T cd534990473b46eda79b629c9475d1e2 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.430860 1685 ts_tablet_manager.cc:1428] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260621 02:41:58.431489 1692 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:58.432157 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:41:58.435458 1685 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:58.432039 1690 tablet_replica.cc:330] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.435801 797 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]
I20260621 02:41:58.435853 1690 raft_consensus.cc:2229] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.436092 1690 raft_consensus.cc:2258] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.436743 1690 ts_tablet_manager.cc:1905] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.437443 797 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47520 (request call id 38) took 3023 ms. Trace:
I20260621 02:41:58.437557 797 rpcz_store.cc:276] 0621 02:41:55.414292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.245352 (+1831060us) service_pool.cc:227] Handling call
0621 02:41:58.029080 (+783728us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0621 02:41:58.437382 (+408302us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":227815,"Hive Metastore.run_cpu_time_us":181,"Hive Metastore.run_wall_time_us":177303}
I20260621 02:41:58.441882 1685 tablet_bootstrap.cc:654] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.443710 1692 tablet_bootstrap.cc:654] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.443552 1652 consensus_queue.cc:1035] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.444499 1626 consensus_queue.cc:1035] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.454197 1692 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:58.421308 1684 ts_tablet_manager.cc:1918] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:58.455278 1684 log.cc:1196] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/3dac6c7a546048d6ae29186f789ca188
I20260621 02:41:58.455742 1684 ts_tablet_manager.cc:1939] T 3dac6c7a546048d6ae29186f789ca188 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.455792 1686 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:58.455861 1692 ts_tablet_manager.cc:1397] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.000s
I20260621 02:41:58.456796 1692 raft_consensus.cc:348] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.457620 1686 ts_tablet_manager.cc:1397] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.092s user 0.015s sys 0.012s
I20260621 02:41:58.458010 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu pid 696
I20260621 02:41:58.458652 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 3dac6c7a546048d6ae29186f789ca188 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
I20260621 02:41:58.458913 1692 raft_consensus.cc:374] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.459064 1692 raft_consensus.cc:729] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.459128 760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260621 02:41:58.459364 1692 consensus_queue.cc:260] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.459847 1684 tablet_replica.cc:330] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.463192 1684 raft_consensus.cc:2229] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.463515 1684 raft_consensus.cc:2258] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.464231 1692 ts_tablet_manager.cc:1428] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260621 02:41:58.466020 1685 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:58.466233 1685 ts_tablet_manager.cc:1397] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.000s
I20260621 02:41:58.459596 1686 raft_consensus.cc:348] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.466671 1686 raft_consensus.cc:374] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.466809 1686 raft_consensus.cc:729] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.467015 1685 raft_consensus.cc:348] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.467260 1685 raft_consensus.cc:374] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.467368 1685 raft_consensus.cc:729] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.467651 1685 consensus_queue.cc:260] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.468396 1685 ts_tablet_manager.cc:1428] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:58.468851 1692 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:58.470754 1692 tablet_bootstrap.cc:654] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.471091 1684 ts_tablet_manager.cc:1905] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.473562 1686 consensus_queue.cc:260] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.474395 1686 ts_tablet_manager.cc:1428] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260621 02:41:58.474740 1686 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:58.476879 1686 tablet_bootstrap.cc:654] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.479025 1684 ts_tablet_manager.cc:1918] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.480204 1684 log.cc:1196] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/97f3b4a1836740df984e0f5329267930
I20260621 02:41:58.480993 1684 ts_tablet_manager.cc:1939] T 97f3b4a1836740df984e0f5329267930 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.482110 1690 ts_tablet_manager.cc:1918] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.482403 1690 log.cc:1196] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/750ee0afb60d44c4b6d70947edcc9096
I20260621 02:41:58.483254 1690 ts_tablet_manager.cc:1939] T 750ee0afb60d44c4b6d70947edcc9096 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.485029 1684 tablet_replica.cc:330] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.486027 1686 tablet_bootstrap.cc:492] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:58.486194 1684 raft_consensus.cc:2229] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.486261 1686 ts_tablet_manager.cc:1397] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260621 02:41:58.486471 1684 raft_consensus.cc:2258] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.487171 1684 ts_tablet_manager.cc:1905] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.487088 1686 raft_consensus.cc:348] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.487444 1686 raft_consensus.cc:374] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.487609 1686 raft_consensus.cc:729] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.487937 1686 consensus_queue.cc:260] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.488678 1686 ts_tablet_manager.cc:1428] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:58.493794 1684 ts_tablet_manager.cc:1918] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.493954 1684 log.cc:1196] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/a9ecff86eae34204a735dca560a2f85b
I20260621 02:41:58.494339 1684 ts_tablet_manager.cc:1939] T a9ecff86eae34204a735dca560a2f85b P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.495219 1684 tablet_replica.cc:330] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.495481 1684 raft_consensus.cc:2229] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.495456 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet a9ecff86eae34204a735dca560a2f85b (table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]) successfully deleted
I20260621 02:41:58.495682 1684 raft_consensus.cc:2258] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.496176 1684 ts_tablet_manager.cc:1905] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.485939 1692 tablet_bootstrap.cc:492] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:58.500567 1692 ts_tablet_manager.cc:1397] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.004s
I20260621 02:41:58.501616 1692 raft_consensus.cc:348] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.501874 1692 raft_consensus.cc:374] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.501945 1692 raft_consensus.cc:729] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.502169 1692 consensus_queue.cc:260] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.502770 1692 ts_tablet_manager.cc:1428] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260621 02:41:58.503077 1692 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:58.504489 1684 ts_tablet_manager.cc:1918] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.504630 1692 tablet_bootstrap.cc:654] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:58.504635 1684 log.cc:1196] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/750ee0afb60d44c4b6d70947edcc9096
I20260621 02:41:58.505095 1684 ts_tablet_manager.cc:1939] T 750ee0afb60d44c4b6d70947edcc9096 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.506410 1684 tablet_replica.cc:330] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.506676 1684 raft_consensus.cc:2229] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.506943 1684 raft_consensus.cc:2258] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.507555 1684 ts_tablet_manager.cc:1905] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.513087 1684 ts_tablet_manager.cc:1918] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.513343 1684 log.cc:1196] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/3cefa90be47244babf78e52753e663d5
I20260621 02:41:58.513908 1684 ts_tablet_manager.cc:1939] T 3cefa90be47244babf78e52753e663d5 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.514864 1692 tablet_bootstrap.cc:492] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:58.515072 1692 ts_tablet_manager.cc:1397] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20260621 02:41:58.515443 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 3cefa90be47244babf78e52753e663d5 (table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]) successfully deleted
I20260621 02:41:58.515967 1684 tablet_replica.cc:330] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:58.515836 1692 raft_consensus.cc:348] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.516057 1692 raft_consensus.cc:374] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:58.516281 1684 raft_consensus.cc:2229] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.516212 1692 raft_consensus.cc:729] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:58.516572 1684 raft_consensus.cc:2258] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.516626 1692 consensus_queue.cc:260] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.517877 1692 ts_tablet_manager.cc:1428] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260621 02:41:58.518049 1684 ts_tablet_manager.cc:1905] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.522527 1690 tablet_replica.cc:330] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.522846 1690 raft_consensus.cc:2229] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.523514 1690 raft_consensus.cc:2258] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.524212 1690 ts_tablet_manager.cc:1905] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.530896 1690 ts_tablet_manager.cc:1918] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:58.531121 1690 log.cc:1196] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/3dac6c7a546048d6ae29186f789ca188
I20260621 02:41:58.531355 1483 catalog_manager.cc:3411] renamed table default.table_55949c61dce74206ba47a1657f192207 [id=2bc21e717ceb45cfa1480e0a612f2f60] in HMS: new name default.table_9d5ad560ef6b47d1b30f5b78b7638733
I20260621 02:41:58.532127 1690 ts_tablet_manager.cc:1939] T 3dac6c7a546048d6ae29186f789ca188 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.533278 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 3dac6c7a546048d6ae29186f789ca188 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
I20260621 02:41:58.533787 1690 tablet_replica.cc:330] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.534062 1690 raft_consensus.cc:2229] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.534369 1690 raft_consensus.cc:2258] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.534824 1684 ts_tablet_manager.cc:1918] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:58.535009 1684 log.cc:1196] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:58.535238 1690 ts_tablet_manager.cc:1905] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.535427 1684 ts_tablet_manager.cc:1939] T d80d37015a6e47f39cc0b9c197f150de P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:58.542611 1690 ts_tablet_manager.cc:1918] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.542888 1690 log.cc:1196] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/97f3b4a1836740df984e0f5329267930
I20260621 02:41:58.543455 1690 ts_tablet_manager.cc:1939] T 97f3b4a1836740df984e0f5329267930 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.545130 1690 tablet_replica.cc:330] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.545423 1690 raft_consensus.cc:2229] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:58.545814 1690 raft_consensus.cc:2258] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.546463 1690 ts_tablet_manager.cc:1905] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.547134 798 catalog_manager.cc:2148] created HMS catalog entry for table [id=ab550098ce024fc98d309badd2c7f1ef]
W20260621 02:41:58.547924 798 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER
I20260621 02:41:58.552640 1690 ts_tablet_manager.cc:1918] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.552951 1690 log.cc:1196] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/a9ecff86eae34204a735dca560a2f85b
I20260621 02:41:58.553498 1690 ts_tablet_manager.cc:1939] T a9ecff86eae34204a735dca560a2f85b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.555035 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet a9ecff86eae34204a735dca560a2f85b (table default.table_db696663f6f14d8cb1c0aee6f43c48a7 [id=5a1f4f5b120142c7a45800a60af93b51]) successfully deleted
I20260621 02:41:58.555418 1690 tablet_replica.cc:330] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.555958 1690 raft_consensus.cc:2229] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.556073 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet d80d37015a6e47f39cc0b9c197f150de (table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]) successfully deleted
I20260621 02:41:58.556344 1690 raft_consensus.cc:2258] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.556996 1690 ts_tablet_manager.cc:1905] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.557423 1626 consensus_queue.cc:1035] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.564563 1690 ts_tablet_manager.cc:1918] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:58.568612 1690 log.cc:1196] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/3cefa90be47244babf78e52753e663d5
I20260621 02:41:58.569190 1690 ts_tablet_manager.cc:1939] T 3cefa90be47244babf78e52753e663d5 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.572369 1690 tablet_replica.cc:330] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:58.572444 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 3cefa90be47244babf78e52753e663d5 (table default.table_377281571f164709ac6324086e74e1a5 [id=7fad0ad501a942efa6a0f0a731be5fc6]) successfully deleted
I20260621 02:41:58.573590 1690 raft_consensus.cc:2229] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:58.573874 1690 raft_consensus.cc:2258] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:58.578087 1690 ts_tablet_manager.cc:1905] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:58.587998 1702 consensus_queue.cc:1035] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.588965 1690 ts_tablet_manager.cc:1918] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:58.589116 1690 log.cc:1196] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:58.589538 1690 ts_tablet_manager.cc:1939] T d80d37015a6e47f39cc0b9c197f150de P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:58.590581 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet d80d37015a6e47f39cc0b9c197f150de (table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]) successfully deleted
I20260621 02:41:58.603751 1472 consensus_queue.cc:1035] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.612859 1702 raft_consensus.cc:482] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:58.613200 1702 raft_consensus.cc:504] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.614454 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f1bd2ccc74f4a3f856c56ad73602bfe" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:58.614735 987 raft_consensus.cc:2454] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:58.615324 1196 leader_election.cc:302] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:58.615594 1472 raft_consensus.cc:482] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:58.615808 1472 raft_consensus.cc:504] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.616520 1472 leader_election.cc:288] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:58.617422 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:58.617712 1127 raft_consensus.cc:2454] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:58.618254 926 leader_election.cc:302] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:58.618398 1710 raft_consensus.cc:2781] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:58.618495 1710 raft_consensus.cc:482] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:58.618608 1710 raft_consensus.cc:3037] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:58.619616 1472 raft_consensus.cc:2781] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:58.619586 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:58.619717 1472 raft_consensus.cc:482] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:58.619822 1472 raft_consensus.cc:3037] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:58.619830 1262 raft_consensus.cc:2454] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:58.623544 1472 raft_consensus.cc:504] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.624881 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:58.625092 1127 raft_consensus.cc:3037] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
W20260621 02:41:58.627048 1198 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.97.2:42873, user_credentials={real_user=slave}} blocked reactor thread for 56906.9us
I20260621 02:41:58.628567 1127 raft_consensus.cc:2454] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:58.629151 926 leader_election.cc:302] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:58.629522 1712 raft_consensus.cc:2781] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:58.629760 1702 leader_election.cc:288] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:58.630687 1472 leader_election.cc:288] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:58.634799 793 catalog_manager.cc:2148] created HMS catalog entry for table [id=9c8111f103d34b82bd95f2365048da78]
W20260621 02:41:58.635885 793 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER
I20260621 02:41:58.647533 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f1bd2ccc74f4a3f856c56ad73602bfe" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:58.646816 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:58.647914 1126 raft_consensus.cc:2454] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:41:58.648082 1261 raft_consensus.cc:3037] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:58.649507 1718 consensus_queue.cc:1035] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:58.650641 1712 raft_consensus.cc:686] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:58.651079 1712 consensus_queue.cc:237] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:41:58.678671 1261 raft_consensus.cc:2454] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:58.679587 1710 raft_consensus.cc:504] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.685516 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f1bd2ccc74f4a3f856c56ad73602bfe" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:58.685838 988 raft_consensus.cc:3037] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:58.687023 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f1bd2ccc74f4a3f856c56ad73602bfe" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:58.687286 1126 raft_consensus.cc:3037] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:58.689030 988 raft_consensus.cc:2454] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:58.689538 1196 leader_election.cc:302] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:58.689997 1702 raft_consensus.cc:2781] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:58.690179 1702 raft_consensus.cc:686] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:41:58.690539 1126 raft_consensus.cc:2454] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:41:58.690891 1702 consensus_queue.cc:237] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:58.691190 1710 leader_election.cc:288] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:58.694444 794 catalog_manager.cc:2148] created HMS catalog entry for table [id=8d348cfda3634dabb91ed0f94a9d8494]
W20260621 02:41:58.695272 794 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER
I20260621 02:41:58.703522 1482 catalog_manager.cc:3411] renamed table default.table_65a5205e941c44c5bdc59e0846793cb3 [id=334d63b5eaaf48de9bc46f4473bea4af] in HMS: new name default.table_d0753d0b484d47f691d51bf949845520
I20260621 02:41:58.774873 795 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=b29c379f823c425bb8c96525bd0668da]
I20260621 02:41:58.775385 795 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 35) took 3537 ms. Trace:
I20260621 02:41:58.775481 795 rpcz_store.cc:276] 0621 02:41:55.237843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.071432 (+1833589us) service_pool.cc:227] Handling call
0621 02:41:58.028077 (+956645us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.028615 (+ 538us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:58.216156 (+187541us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:58.216900 (+ 744us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.216904 (+ 4us) write_op.cc:454] Released schema lock
0621 02:41:58.217172 (+ 268us) catalog_manager.cc:2155] Rolling back HMS table creation
0621 02:41:58.775303 (+558131us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:58.216812 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER)
0621 02:41:58.216828 (+ 16us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.216834 (+ 6us) write_op.cc:454] Released schema lock
0621 02:41:58.216838 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":596555,"Hive Metastore.run_cpu_time_us":460,"Hive Metastore.run_wall_time_us":147955,"child_traces":[["op",{}]]}
I20260621 02:41:58.782361 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu with pid 696
I20260621 02:41:58.800598 1481 catalog_manager.cc:3411] renamed table default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6] in HMS: new name default.table_5a02f30d3adf4196b07934e402f06d8e
I20260621 02:41:58.809155 1724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:41:58.809451 1724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:41:58.810758 1724 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
I20260621 02:41:58.810827 1501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 3 candidate_status { last_received { term: 2 index: 81 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:41:58.829726 791 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=c8f2e71516fc4297ac8177de874b068a]
I20260621 02:41:58.830107 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 36) took 3513 ms. Trace:
I20260621 02:41:58.830228 791 rpcz_store.cc:276] 0621 02:41:55.316834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.116171 (+1799337us) service_pool.cc:227] Handling call
0621 02:41:58.028477 (+912306us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.028934 (+ 457us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:58.257145 (+228211us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:58.257934 (+ 789us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.257941 (+ 7us) write_op.cc:454] Released schema lock
0621 02:41:58.258192 (+ 251us) catalog_manager.cc:2155] Rolling back HMS table creation
0621 02:41:58.830063 (+571871us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:58.257855 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER)
0621 02:41:58.257866 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.257872 (+ 6us) write_op.cc:454] Released schema lock
0621 02:41:58.257876 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":703315,"Hive Metastore.run_cpu_time_us":523,"Hive Metastore.run_wall_time_us":95779,"child_traces":[["op",{}]]}
W20260621 02:41:58.839841 787 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:41:58.841702 1725 negotiation.cc:337] Failed RPC negotiation. Trace:
0621 02:41:58.837632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.61:35493 (local address 127.0.97.3:37611)
0621 02:41:58.840502 (+ 2870us) negotiation.cc:107] Waiting for socket to connect
0621 02:41:58.840605 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":2719,"thread_start_us":2900,"threads_started":1}
W20260621 02:41:58.853528 787 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:41:58.853883 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:41:58.854362 1724 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260621 02:41:58.856392 1726 negotiation.cc:337] Failed RPC negotiation. Trace:
0621 02:41:58.838024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.97.61:35493 (local address 127.0.97.2:33503)
0621 02:41:58.855549 (+ 17525us) negotiation.cc:107] Waiting for socket to connect
0621 02:41:58.855668 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":17410,"thread_start_us":17316,"threads_started":1}
I20260621 02:41:58.887810 1486 catalog_manager.cc:3411] renamed table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5] in HMS: new name default.table_5a92341192d44cc889170dcf2bdf23dc
I20260621 02:41:58.896855 798 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=ab550098ce024fc98d309badd2c7f1ef]
I20260621 02:41:58.897192 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 37) took 3559 ms. Trace:
I20260621 02:41:58.897305 798 rpcz_store.cc:276] 0621 02:41:55.337328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.221688 (+1884360us) service_pool.cc:227] Handling call
0621 02:41:58.029137 (+807449us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.029724 (+ 587us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:58.547080 (+517356us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:58.547812 (+ 732us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.547816 (+ 4us) write_op.cc:454] Released schema lock
0621 02:41:58.548033 (+ 217us) catalog_manager.cc:2155] Rolling back HMS table creation
0621 02:41:58.897157 (+349124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:58.547736 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER)
0621 02:41:58.547748 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.547754 (+ 6us) write_op.cc:454] Released schema lock
0621 02:41:58.547759 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":685946,"Hive Metastore.run_cpu_time_us":468,"Hive Metastore.run_wall_time_us":179563,"child_traces":[["op",{}]]}
W20260621 02:41:58.954155 1476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:41:58.973593 1476 consensus_peers.cc:487] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 -> Peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Couldn't send request to peer 3391f089f71e447b9628bac16fe3443c. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:41:58.978783 793 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=9c8111f103d34b82bd95f2365048da78]
I20260621 02:41:58.979179 793 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 39) took 3560 ms. Trace:
I20260621 02:41:58.979331 793 rpcz_store.cc:276] 0621 02:41:55.418710 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.302299 (+1883589us) service_pool.cc:227] Handling call
0621 02:41:58.037836 (+735537us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.038367 (+ 531us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:58.634752 (+596385us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:58.635687 (+ 935us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.635693 (+ 6us) write_op.cc:454] Released schema lock
0621 02:41:58.636001 (+ 308us) catalog_manager.cc:2155] Rolling back HMS table creation
0621 02:41:58.979106 (+343105us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:58.635589 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER)
0621 02:41:58.635606 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.635617 (+ 11us) write_op.cc:454] Released schema lock
0621 02:41:58.635624 (+ 7us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":768940,"Hive Metastore.run_cpu_time_us":489,"Hive Metastore.run_wall_time_us":169327,"child_traces":[["op",{}]]}
I20260621 02:41:58.982146 1485 catalog_manager.cc:3411] renamed table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b] in HMS: new name default.table_99d895f423774b16bccf9a8c0a5671fe
I20260621 02:41:59.018270 1489 catalog_manager.cc:2148] created HMS catalog entry for table [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:41:59.087577 794 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=8d348cfda3634dabb91ed0f94a9d8494]
I20260621 02:41:59.087925 794 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47520 (request call id 40) took 3474 ms. Trace:
I20260621 02:41:59.088032 794 rpcz_store.cc:276] 0621 02:41:55.613801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:57.309690 (+1695889us) service_pool.cc:227] Handling call
0621 02:41:58.046166 (+736476us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.046653 (+ 487us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:58.694409 (+647756us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:58.695131 (+ 722us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.695135 (+ 4us) write_op.cc:454] Released schema lock
0621 02:41:58.695359 (+ 224us) catalog_manager.cc:2155] Rolling back HMS table creation
0621 02:41:59.087853 (+392494us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:58.695056 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 5d142d25b86d4ad7935e806b7ebe8599 is not leader of this config: current role FOLLOWER)
0621 02:41:58.695068 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:58.695076 (+ 8us) write_op.cc:454] Released schema lock
0621 02:41:58.695080 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":870727,"Hive Metastore.run_cpu_time_us":518,"Hive Metastore.run_wall_time_us":168717,"child_traces":[["op",{}]]}
W20260621 02:41:59.088958 1315 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:44219)
I20260621 02:41:59.090029 1489 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
W20260621 02:41:59.090564 1489 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6f1bd2ccc74f4a3f856c56ad73602bfe consensus state has no leader
I20260621 02:41:59.091225 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 22a484bc2d4e4488aa3575792b40ec62 (DEFAULT_TABLE table=default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.091470 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 22a484bc2d4e4488aa3575792b40ec62 (DEFAULT_TABLE table=default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.091660 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a484bc2d4e4488aa3575792b40ec62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.091706 1484 catalog_manager.cc:2148] created HMS catalog entry for table [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:41:59.091831 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a484bc2d4e4488aa3575792b40ec62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.101413 964 tablet_service.cc:1467] Processing CreateTablet for tablet 22a484bc2d4e4488aa3575792b40ec62 (DEFAULT_TABLE table=default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.101924 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a484bc2d4e4488aa3575792b40ec62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.106477 1739 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.106525 1489 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
I20260621 02:41:59.106734 1489 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:59.107471 1489 catalog_manager.cc:5495] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:59.112123 1739 tablet_bootstrap.cc:654] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.114387 1741 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.120929 1741 tablet_bootstrap.cc:654] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.123512 1739 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.123754 1739 ts_tablet_manager.cc:1397] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260621 02:41:59.124670 1739 raft_consensus.cc:348] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.125078 1739 raft_consensus.cc:374] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.125223 1739 raft_consensus.cc:729] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.125553 1739 consensus_queue.cc:260] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.126577 964 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:59.129549 1739 ts_tablet_manager.cc:1428] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260621 02:41:59.129904 1106 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.133613 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet a9ecff86eae34204a735dca560a2f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
W20260621 02:41:59.134563 1489 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 consensus state has no leader
I20260621 02:41:59.136500 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dac6c7a546048d6ae29186f789ca188 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ef4cdcf4c9e4db2a776a1b2516c0745) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.136729 1107 tablet_service.cc:1514] Processing DeleteTablet for tablet cd534990473b46eda79b629c9475d1e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6f1bd2ccc74f4a3f856c56ad73602bfe) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.136842 1103 tablet_service.cc:1514] Processing DeleteTablet for tablet 750ee0afb60d44c4b6d70947edcc9096 with delete_type TABLET_DATA_DELETED (replaced by tablet d80d37015a6e47f39cc0b9c197f150de) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.136744 1102 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cefa90be47244babf78e52753e663d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.137233 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet 97f3b4a1836740df984e0f5329267930 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd945b247c14e8388646457c1fbac00) from {username='slave'} at 127.0.0.1:35002
W20260621 02:41:59.137737 1471 catalog_manager.cc:4808] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): delete failed for tablet d80d37015a6e47f39cc0b9c197f150de because the tablet was not found. No further retry: Not found: Tablet not found: d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:59.137820 1741 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.137975 1741 ts_tablet_manager.cc:1397] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.004s
I20260621 02:41:59.138975 1741 raft_consensus.cc:348] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.139323 1741 raft_consensus.cc:374] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.139474 1741 raft_consensus.cc:729] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.139809 1741 consensus_queue.cc:260] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.146714 1741 ts_tablet_manager.cc:1428] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260621 02:41:59.149978 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 908e00c0865749d2b19417e336888311 (DEFAULT_TABLE table=default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.150426 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 908e00c0865749d2b19417e336888311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.151156 1487 catalog_manager.cc:2148] created HMS catalog entry for table [id=99c5624d74204218be0a0a5c4a687869]
W20260621 02:41:59.155351 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet d80d37015a6e47f39cc0b9c197f150de because the tablet was not found. No further retry: Not found: Tablet not found: d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:59.155922 1104 tablet_service.cc:1467] Processing CreateTablet for tablet 908e00c0865749d2b19417e336888311 (DEFAULT_TABLE table=default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.156294 1740 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.156360 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 908e00c0865749d2b19417e336888311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.158406 1740 tablet_bootstrap.cc:654] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
W20260621 02:41:59.159420 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet a9ecff86eae34204a735dca560a2f85b because the tablet was not found. No further retry: Not found: Tablet not found: a9ecff86eae34204a735dca560a2f85b
W20260621 02:41:59.159688 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet 3dac6c7a546048d6ae29186f789ca188 because the tablet was not found. No further retry: Not found: Tablet not found: 3dac6c7a546048d6ae29186f789ca188
W20260621 02:41:59.159933 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet cd534990473b46eda79b629c9475d1e2 because the tablet was not found. No further retry: Not found: Tablet not found: cd534990473b46eda79b629c9475d1e2
W20260621 02:41:59.160141 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet 750ee0afb60d44c4b6d70947edcc9096 because the tablet was not found. No further retry: Not found: Tablet not found: 750ee0afb60d44c4b6d70947edcc9096
W20260621 02:41:59.160421 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet 3cefa90be47244babf78e52753e663d5 because the tablet was not found. No further retry: Not found: Tablet not found: 3cefa90be47244babf78e52753e663d5
W20260621 02:41:59.160631 1475 catalog_manager.cc:4808] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): delete failed for tablet 97f3b4a1836740df984e0f5329267930 because the tablet was not found. No further retry: Not found: Tablet not found: 97f3b4a1836740df984e0f5329267930
W20260621 02:41:59.161345 1476 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 consensus state has no leader
I20260621 02:41:59.167055 964 tablet_service.cc:1467] Processing CreateTablet for tablet 908e00c0865749d2b19417e336888311 (DEFAULT_TABLE table=default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.167539 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 908e00c0865749d2b19417e336888311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.167634 1484 catalog_manager.cc:5495] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc reported cstate change: term changed from 0 to 1, leader changed from <none> to a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3). New cstate: current_term: 1 leader_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:59.168262 1484 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:59.168890 1484 catalog_manager.cc:5587] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259) does not have the latest schema for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
I20260621 02:41:59.170957 1487 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42094 (request call id 12) took 1048 ms. Trace:
I20260621 02:41:59.171111 1487 rpcz_store.cc:276] 0621 02:41:58.122445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.166648 (+ 44203us) service_pool.cc:227] Handling call
0621 02:41:58.214900 (+ 48252us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x6150000409a4. stack: 00007ff00ee8966e 00007ff00ee89430 00007ff00df105ed 00000000008ea064 00000000008ea02d 00007ff01d5a227d 00007ff01d5a2373 00007ff01a3c4361 00007ff021d3766a 00007ff021ebf313 00007ff0191b1466 00007ff0191b1195 00007ff0159c59be 00007ff0159c479e 00007ff0159cab25 00007ff0159cb54f
0621 02:41:58.295772 (+ 80872us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.296215 (+ 443us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:59.151117 (+854902us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:59.170641 (+ 19524us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:59.170776 (+ 135us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:59.170880 (+ 104us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:59.156260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:59.156382 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:59.156391 (+ 9us) write_op.cc:435] Acquired schema lock
0621 02:41:59.156395 (+ 4us) tablet.cc:660] Decoding operations
0621 02:41:59.156496 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:59.156512 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:59.156520 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:59.156608 (+ 88us) tablet.cc:699] Row locks acquired
0621 02:41:59.156611 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:59.156656 (+ 45us) write_op.cc:270] Start()
0621 02:41:59.156693 (+ 37us) write_op.cc:276] Timestamp: P: 1782009719156588 usec, L: 0
0621 02:41:59.156697 (+ 4us) op_driver.cc:331] REPLICATION: starting
0621 02:41:59.156927 (+ 230us) log.cc:842] Serialized 432 byte log entry
0621 02:41:59.162549 (+ 5622us) op_driver.cc:444] REPLICATION: finished
0621 02:41:59.169967 (+ 7418us) write_op.cc:301] APPLY: starting
0621 02:41:59.169993 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:59.170055 (+ 62us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:59.170093 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:59.170239 (+ 146us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:59.170293 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:59.170304 (+ 11us) write_op.cc:312] APPLY: finished
0621 02:41:59.170417 (+ 113us) log.cc:842] Serialized 28 byte log entry
0621 02:41:59.170499 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.170530 (+ 31us) write_op.cc:454] Released schema lock
0621 02:41:59.170540 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:59.170621 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.170627 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":793998,"Hive Metastore.run_cpu_time_us":263,"Hive Metastore.run_wall_time_us":60519,"spinlock_wait_cycles":84673920,"child_traces":[["op",{"apply.queue_time_us":7322,"apply.run_cpu_time_us":739,"apply.run_wall_time_us":739,"num_ops":2,"prepare.queue_time_us":4524,"prepare.run_cpu_time_us":789,"prepare.run_wall_time_us":790,"raft.queue_time_us":1163,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"replication_time_us":5819}]]}
I20260621 02:41:59.174835 1741 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.176518 1741 tablet_bootstrap.cc:654] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
W20260621 02:41:59.182049 786 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
I20260621 02:41:59.189554 1741 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.189831 1741 ts_tablet_manager.cc:1397] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20260621 02:41:59.190699 1741 raft_consensus.cc:348] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.191037 1741 raft_consensus.cc:374] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.191170 1741 raft_consensus.cc:729] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.191541 1741 consensus_queue.cc:260] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.193207 1739 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.195057 1739 tablet_bootstrap.cc:654] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.195971 1741 ts_tablet_manager.cc:1428] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260621 02:41:59.200129 1740 tablet_bootstrap.cc:492] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.200366 1740 ts_tablet_manager.cc:1397] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.027s
I20260621 02:41:59.201261 1740 raft_consensus.cc:348] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.201596 1740 raft_consensus.cc:374] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.201542 1238 tablet_service.cc:1514] Processing DeleteTablet for tablet d80d37015a6e47f39cc0b9c197f150de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:58 UTC) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:59.201731 1740 raft_consensus.cc:729] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.201992 1740 consensus_queue.cc:260] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.202620 1740 ts_tablet_manager.cc:1428] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260621 02:41:59.203013 1740 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.205664 1104 tablet_service.cc:1467] Processing CreateTablet for tablet d16abd1e360844519831cf81eda9a6e1 (DEFAULT_TABLE table=default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.205798 1480 catalog_manager.cc:2148] created HMS catalog entry for table [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:41:59.206110 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16abd1e360844519831cf81eda9a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.207418 1740 tablet_bootstrap.cc:654] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.209124 1740 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.209244 1740 ts_tablet_manager.cc:1397] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20260621 02:41:59.210484 1740 raft_consensus.cc:348] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.210727 1740 raft_consensus.cc:374] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.210819 1740 raft_consensus.cc:729] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.211027 1236 tablet_service.cc:1467] Processing CreateTablet for tablet d16abd1e360844519831cf81eda9a6e1 (DEFAULT_TABLE table=default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.211486 1236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16abd1e360844519831cf81eda9a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.211050 1740 consensus_queue.cc:260] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.213055 1740 ts_tablet_manager.cc:1428] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260621 02:41:59.214387 964 tablet_service.cc:1467] Processing CreateTablet for tablet d16abd1e360844519831cf81eda9a6e1 (DEFAULT_TABLE table=default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.214825 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16abd1e360844519831cf81eda9a6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.228869 1740 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.230592 1740 tablet_bootstrap.cc:654] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.231567 1480 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42094 (request call id 10) took 1109 ms. Trace:
I20260621 02:41:59.231745 1480 rpcz_store.cc:276] 0621 02:41:58.122124 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.124220 (+ 2096us) service_pool.cc:227] Handling call
0621 02:41:58.296647 (+172427us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.297110 (+ 463us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:59.205750 (+908640us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:59.231227 (+ 25477us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:59.231382 (+ 155us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:59.231511 (+ 129us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:59.206432 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:59.206551 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:59.206558 (+ 7us) write_op.cc:435] Acquired schema lock
0621 02:41:59.206560 (+ 2us) tablet.cc:660] Decoding operations
0621 02:41:59.206650 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:59.206665 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:59.206671 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:59.206752 (+ 81us) tablet.cc:699] Row locks acquired
0621 02:41:59.206756 (+ 4us) write_op.cc:260] PREPARE: finished
0621 02:41:59.206793 (+ 37us) write_op.cc:270] Start()
0621 02:41:59.206826 (+ 33us) write_op.cc:276] Timestamp: P: 1782009719206717 usec, L: 0
0621 02:41:59.206831 (+ 5us) op_driver.cc:331] REPLICATION: starting
0621 02:41:59.207012 (+ 181us) log.cc:842] Serialized 432 byte log entry
0621 02:41:59.228325 (+ 21313us) op_driver.cc:444] REPLICATION: finished
0621 02:41:59.229638 (+ 1313us) write_op.cc:301] APPLY: starting
0621 02:41:59.229696 (+ 58us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:59.229745 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:59.229784 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:59.229914 (+ 130us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:59.230312 (+ 398us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:59.230318 (+ 6us) write_op.cc:312] APPLY: finished
0621 02:41:59.230594 (+ 276us) log.cc:842] Serialized 28 byte log entry
0621 02:41:59.231088 (+ 494us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.231115 (+ 27us) write_op.cc:454] Released schema lock
0621 02:41:59.231124 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":853661,"Hive Metastore.run_cpu_time_us":279,"Hive Metastore.run_wall_time_us":54626,"child_traces":[["op",{"apply.queue_time_us":1240,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":703,"prepare.run_wall_time_us":1073,"raft.queue_time_us":85,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":9,"replication_time_us":21465}]]}
I20260621 02:41:59.233045 1480 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:41:59.233402 1480 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:41:59.233494 1484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:41:59.233709 1484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:41:59.234946 1489 catalog_manager.cc:5495] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1). New cstate: current_term: 1 leader_uuid: "35b23c9f06314e4abf6d8aff8989e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260621 02:41:59.236191 1489 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
I20260621 02:41:59.236481 1489 catalog_manager.cc:5587] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793) does not have the latest schema for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:59.241650 1740 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.241828 1740 ts_tablet_manager.cc:1397] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260621 02:41:59.242690 1740 raft_consensus.cc:348] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.243070 1740 raft_consensus.cc:374] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.243186 1740 raft_consensus.cc:729] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.243494 1740 consensus_queue.cc:260] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.244382 1751 tablet_replica.cc:330] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:59.244611 1751 raft_consensus.cc:2229] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.244648 1741 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.244860 1751 raft_consensus.cc:2258] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.245452 1751 ts_tablet_manager.cc:1905] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.246130 1740 ts_tablet_manager.cc:1428] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260621 02:41:59.246953 1741 tablet_bootstrap.cc:654] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.253604 1739 tablet_bootstrap.cc:492] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.253890 1739 ts_tablet_manager.cc:1397] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.061s user 0.015s sys 0.016s
I20260621 02:41:59.254501 1751 ts_tablet_manager.cc:1918] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260621 02:41:59.254709 1751 log.cc:1196] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/d80d37015a6e47f39cc0b9c197f150de
I20260621 02:41:59.254815 1739 raft_consensus.cc:348] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.255198 1739 raft_consensus.cc:374] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.255262 1751 ts_tablet_manager.cc:1939] T d80d37015a6e47f39cc0b9c197f150de P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:59.255340 1739 raft_consensus.cc:729] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.255610 1739 consensus_queue.cc:260] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.256347 1739 ts_tablet_manager.cc:1428] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:59.257696 1739 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.259442 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet d80d37015a6e47f39cc0b9c197f150de (table default.table_73d184c634e44e4fa7308cc8ce9305fc [id=f046222f946a4a3cb4fb98ba9673fad6]) successfully deleted
I20260621 02:41:59.260017 1739 tablet_bootstrap.cc:654] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.263355 1238 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4d7a76b39841988629f0db75f1f69e (DEFAULT_TABLE table=default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.263360 1104 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4d7a76b39841988629f0db75f1f69e (DEFAULT_TABLE table=default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.263772 1238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4d7a76b39841988629f0db75f1f69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.263803 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4d7a76b39841988629f0db75f1f69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.264791 1488 catalog_manager.cc:2148] created HMS catalog entry for table [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:41:59.271271 1740 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.273289 1740 tablet_bootstrap.cc:654] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.276348 1740 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.276413 964 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4d7a76b39841988629f0db75f1f69e (DEFAULT_TABLE table=default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.276643 1740 ts_tablet_manager.cc:1397] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260621 02:41:59.277406 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4d7a76b39841988629f0db75f1f69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.277571 1740 raft_consensus.cc:348] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.277942 1740 raft_consensus.cc:374] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.278036 1740 raft_consensus.cc:729] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.278271 1740 consensus_queue.cc:260] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.278890 1740 ts_tablet_manager.cc:1428] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:59.279179 1553 catalog_manager.cc:2709] Deleting table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d] in response to Hive Metastore notification log event 27
I20260621 02:41:59.284895 1488 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42094 (request call id 11) took 1162 ms. Trace:
I20260621 02:41:59.284909 1487 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]). Expected version 1 got 0
I20260621 02:41:59.285597 1487 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
I20260621 02:41:59.285075 1488 rpcz_store.cc:276] 0621 02:41:58.122255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:58.156060 (+ 33805us) service_pool.cc:227] Handling call
0621 02:41:58.203400 (+ 47340us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x6150000409a4. stack: 00007ff00ee8966e 00007ff00ee89430 00007ff00df105ed 00000000008ea064 00000000008ea02d 00007ff01d5a227d 00007ff01d5a2373 00007ff01a3c4361 00007ff021d3766a 00007ff021ebf313 00007ff0191b1466 00007ff0191b1195 00007ff0159c59be 00007ff0159c479e 00007ff0159cab25 00007ff0159cb54f
0621 02:41:58.294393 (+ 90993us) catalog_manager.cc:2075] Acquired catalog manager lock
0621 02:41:58.297730 (+ 3337us) catalog_manager.cc:2121] Created new table and tablet info
0621 02:41:59.264743 (+967013us) catalog_manager.cc:2147] Created new table in HMS catalog
0621 02:41:59.284580 (+ 19837us) catalog_manager.cc:2181] Wrote table and tablets to system table
0621 02:41:59.284692 (+ 112us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0621 02:41:59.284829 (+ 137us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:59.265438 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:59.265550 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:59.265556 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:59.265559 (+ 3us) tablet.cc:660] Decoding operations
0621 02:41:59.265649 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:59.265661 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:59.265665 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:59.265752 (+ 87us) tablet.cc:699] Row locks acquired
0621 02:41:59.265754 (+ 2us) write_op.cc:260] PREPARE: finished
0621 02:41:59.265789 (+ 35us) write_op.cc:270] Start()
0621 02:41:59.265822 (+ 33us) write_op.cc:276] Timestamp: P: 1782009719265702 usec, L: 0
0621 02:41:59.265825 (+ 3us) op_driver.cc:331] REPLICATION: starting
0621 02:41:59.266000 (+ 175us) log.cc:842] Serialized 432 byte log entry
0621 02:41:59.283889 (+ 17889us) op_driver.cc:444] REPLICATION: finished
0621 02:41:59.284013 (+ 124us) write_op.cc:301] APPLY: starting
0621 02:41:59.284034 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:59.284083 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:59.284118 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:59.284240 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:59.284283 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0621 02:41:59.284288 (+ 5us) write_op.cc:312] APPLY: finished
0621 02:41:59.284374 (+ 86us) log.cc:842] Serialized 28 byte log entry
0621 02:41:59.284444 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.284465 (+ 21us) write_op.cc:454] Released schema lock
0621 02:41:59.284472 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0621 02:41:59.284560 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.284563 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":907697,"Hive Metastore.run_cpu_time_us":259,"Hive Metastore.run_wall_time_us":59030,"spinlock_wait_cycles":107834240,"child_traces":[["op",{"apply.queue_time_us":69,"apply.run_cpu_time_us":603,"apply.run_wall_time_us":602,"num_ops":2,"prepare.queue_time_us":81,"prepare.run_cpu_time_us":670,"prepare.run_wall_time_us":670,"raft.queue_time_us":356,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":201,"replication_time_us":18040}]]}
I20260621 02:41:59.293217 1489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:41:59.294750 1489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:41:59.301959 1741 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.301985 1553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet b21ad2c9db57446492a0329f899a1afe
I20260621 02:41:59.302157 1739 tablet_bootstrap.cc:492] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.302232 1741 ts_tablet_manager.cc:1397] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.010s
I20260621 02:41:59.302354 1739 ts_tablet_manager.cc:1397] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.021s
I20260621 02:41:59.303205 1741 raft_consensus.cc:348] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.303241 1739 raft_consensus.cc:348] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.303536 1739 raft_consensus.cc:374] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.303674 1739 raft_consensus.cc:729] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.304069 1741 raft_consensus.cc:374] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.304224 1741 raft_consensus.cc:729] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.304052 1739 consensus_queue.cc:260] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.304874 1739 ts_tablet_manager.cc:1428] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260621 02:41:59.304914 964 tablet_service.cc:1514] Processing DeleteTablet for tablet b21ad2c9db57446492a0329f899a1afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:59 UTC) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:59.305274 1739 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.305704 1743 tablet_replica.cc:330] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:59.305984 1743 raft_consensus.cc:2229] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:59.306375 1743 raft_consensus.cc:2258] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.306980 1743 ts_tablet_manager.cc:1905] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.307191 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet b21ad2c9db57446492a0329f899a1afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:59 UTC) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:59.307873 1751 tablet_replica.cc:330] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:59.308281 1751 raft_consensus.cc:2229] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.308287 1739 tablet_bootstrap.cc:654] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.308506 1751 raft_consensus.cc:2258] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.309125 1751 ts_tablet_manager.cc:1905] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.317760 1743 ts_tablet_manager.cc:1918] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:59.318416 1743 log.cc:1196] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/b21ad2c9db57446492a0329f899a1afe
I20260621 02:41:59.318922 1743 ts_tablet_manager.cc:1939] T b21ad2c9db57446492a0329f899a1afe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:59.319110 1751 ts_tablet_manager.cc:1918] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:59.318123 1741 consensus_queue.cc:260] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.320773 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet b21ad2c9db57446492a0329f899a1afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-21 02:41:59 UTC) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.321550 1744 tablet_replica.cc:330] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:59.321776 1744 raft_consensus.cc:2229] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.322002 1744 raft_consensus.cc:2258] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.322674 1744 ts_tablet_manager.cc:1905] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.323719 969 tablet_service.cc:1467] Processing CreateTablet for tablet 5e49f47887e044668800410f7a7b72b4 (DEFAULT_TABLE table=default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.324316 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e49f47887e044668800410f7a7b72b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.327795 1487 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:41:59.328047 1487 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42094:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:41:59.328325 1488 master_service.cc:946] ReplaceTablet: received request to replace tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:59.325186 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 5e49f47887e044668800410f7a7b72b4 (DEFAULT_TABLE table=default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.332067 1744 ts_tablet_manager.cc:1918] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:41:59.332201 1744 log.cc:1196] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/b21ad2c9db57446492a0329f899a1afe
I20260621 02:41:59.332298 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e49f47887e044668800410f7a7b72b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.332633 1744 ts_tablet_manager.cc:1939] T b21ad2c9db57446492a0329f899a1afe P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:59.333755 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet b21ad2c9db57446492a0329f899a1afe (table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]) successfully deleted
I20260621 02:41:59.334321 1741 ts_tablet_manager.cc:1428] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.032s user 0.000s sys 0.002s
I20260621 02:41:59.334846 1104 tablet_service.cc:1467] Processing CreateTablet for tablet 5e49f47887e044668800410f7a7b72b4 (DEFAULT_TABLE table=default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.335585 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e49f47887e044668800410f7a7b72b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.337625 1741 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.339414 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet b21ad2c9db57446492a0329f899a1afe (table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]) successfully deleted
I20260621 02:41:59.339650 1751 log.cc:1196] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/b21ad2c9db57446492a0329f899a1afe
I20260621 02:41:59.340241 1751 ts_tablet_manager.cc:1939] T b21ad2c9db57446492a0329f899a1afe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:59.340869 1741 tablet_bootstrap.cc:654] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.343339 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet b21ad2c9db57446492a0329f899a1afe (table default.table_d92b84136868428790cb79925c3f1a33 [id=478b269794fe46dfa698bdbcf84abc0d]) successfully deleted
I20260621 02:41:59.344018 1261 raft_consensus.cc:1261] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Refusing update from remote peer 35b23c9f06314e4abf6d8aff8989e73e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:59.344568 1126 raft_consensus.cc:1261] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Refusing update from remote peer 35b23c9f06314e4abf6d8aff8989e73e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:59.344847 1712 consensus_queue.cc:1035] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:59.345626 1712 consensus_queue.cc:1035] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:59.357041 1127 raft_consensus.cc:1261] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Refusing update from remote peer a2d4d8ec6f9845f5bbfca1390740aedc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:59.357872 1746 raft_consensus.cc:482] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.358434 1746 raft_consensus.cc:504] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.359381 1746 leader_election.cc:288] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:59.360723 1702 consensus_queue.cc:1035] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:59.362346 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "908e00c0865749d2b19417e336888311" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:59.362697 989 raft_consensus.cc:2454] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:59.363946 1062 leader_election.cc:302] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.365504 1748 raft_consensus.cc:2781] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:59.365677 1748 raft_consensus.cc:482] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:59.365728 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--webserver_interface=127.0.97.61
--webserver_port=41917
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260621 02:41:59.365841 1748 raft_consensus.cc:3037] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.366400 989 raft_consensus.cc:1261] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Refusing update from remote peer a2d4d8ec6f9845f5bbfca1390740aedc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 02:41:59.367091 1710 consensus_queue.cc:1035] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:41:59.368346 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "908e00c0865749d2b19417e336888311" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:59.368637 1262 raft_consensus.cc:2454] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:59.372431 1748 raft_consensus.cc:504] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.378321 1748 leader_election.cc:288] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:59.380023 988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "908e00c0865749d2b19417e336888311" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:59.380290 988 raft_consensus.cc:3037] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.382788 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "908e00c0865749d2b19417e336888311" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:59.383077 1262 raft_consensus.cc:3037] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.383311 1769 tablet.cc:1722] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:59.383596 988 raft_consensus.cc:2454] T 908e00c0865749d2b19417e336888311 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:59.384871 1770 tablet.cc:1722] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:59.390209 1062 leader_election.cc:302] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.391414 1262 raft_consensus.cc:2454] T 908e00c0865749d2b19417e336888311 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:59.393029 1748 raft_consensus.cc:2781] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:59.393807 1748 raft_consensus.cc:686] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:59.394345 1748 consensus_queue.cc:237] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.398298 1488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet 6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.399121 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2fc2340c3d4e0d860c91205eaedf68) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.399435 1744 tablet_replica.cc:330] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:59.399756 1488 catalog_manager.cc:6565] ReplaceTablet: tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 deleted and replaced by tablet 7d2fc2340c3d4e0d860c91205eaedf68
I20260621 02:41:59.406955 964 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2fc2340c3d4e0d860c91205eaedf68) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:59.407357 1743 tablet_replica.cc:330] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:59.407637 1743 raft_consensus.cc:2229] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:59.407887 1743 pending_rounds.cc:62] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Trying to abort 2 pending ops.
I20260621 02:41:59.408041 1743 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7299111810426347520 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_3a337887b0124960a4309bf3ff5d2ed5" dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" new_extra_config { } }
W20260621 02:41:59.408564 1743 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:38350: Aborted: Op aborted
I20260621 02:41:59.409130 1743 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299111807599177728 op_type: NO_OP noop_request { }
I20260621 02:41:59.409282 1743 raft_consensus.cc:2866] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260621 02:41:59.409332 1471 catalog_manager.cc:4920] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): alter failed for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]): Aborted: Op aborted
I20260621 02:41:59.409476 1743 raft_consensus.cc:2258] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.411113 1743 ts_tablet_manager.cc:1905] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.411597 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2fc2340c3d4e0d860c91205eaedf68) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:59.412007 1751 tablet_replica.cc:330] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:59.412828 1746 raft_consensus.cc:482] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.413022 1746 raft_consensus.cc:504] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.413730 1746 leader_election.cc:288] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:59.414966 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
W20260621 02:41:59.415848 1065 leader_election.cc:341] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260621 02:41:59.416304 1744 raft_consensus.cc:2229] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.416733 1744 pending_rounds.cc:62] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Trying to abort 2 pending ops.
I20260621 02:41:59.416836 1744 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7299111810426347520 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_3a337887b0124960a4309bf3ff5d2ed5" dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" new_extra_config { } }
I20260621 02:41:59.417182 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:59.417382 1744 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299111807599177728 op_type: NO_OP noop_request { }
I20260621 02:41:59.417536 1744 raft_consensus.cc:2866] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260621 02:41:59.417654 1744 raft_consensus.cc:2258] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260621 02:41:59.417801 1062 leader_election.cc:341] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260621 02:41:59.417935 1062 leader_election.cc:302] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba; no voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc
I20260621 02:41:59.418454 1746 raft_consensus.cc:2726] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260621 02:41:59.419348 1744 ts_tablet_manager.cc:1905] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.423446 1768 tablet.cc:1722] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:59.427577 1712 raft_consensus.cc:482] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.427767 1712 raft_consensus.cc:504] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.428550 1712 leader_election.cc:288] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:59.429128 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16abd1e360844519831cf81eda9a6e1" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:59.429184 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16abd1e360844519831cf81eda9a6e1" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:59.429411 1127 raft_consensus.cc:2454] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.429534 1262 raft_consensus.cc:2454] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.429962 927 leader_election.cc:302] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:59.430358 1712 raft_consensus.cc:2781] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:59.430454 1712 raft_consensus.cc:482] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:59.430542 1712 raft_consensus.cc:3037] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.432327 964 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.432957 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fc2340c3d4e0d860c91205eaedf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.433713 1712 raft_consensus.cc:504] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.435268 1712 leader_election.cc:288] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:59.435680 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16abd1e360844519831cf81eda9a6e1" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:59.435911 1127 raft_consensus.cc:3037] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.437374 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16abd1e360844519831cf81eda9a6e1" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:59.437743 1262 raft_consensus.cc:3037] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.438225 1744 ts_tablet_manager.cc:1918] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.438416 1744 log.cc:1196] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.440658 1127 raft_consensus.cc:2454] T d16abd1e360844519831cf81eda9a6e1 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:59.440760 1743 ts_tablet_manager.cc:1918] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.440968 1743 log.cc:1196] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.441244 926 leader_election.cc:302] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.441675 1712 raft_consensus.cc:2781] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:59.442233 1744 ts_tablet_manager.cc:1939] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:59.441740 1743 ts_tablet_manager.cc:1939] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:59.443660 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.443233 1109 tablet_service.cc:1467] Processing CreateTablet for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (DEFAULT_TABLE table=default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.444247 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fc2340c3d4e0d860c91205eaedf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.444311 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d2fc2340c3d4e0d860c91205eaedf68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.451447 1740 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.453523 1740 tablet_bootstrap.cc:654] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.453984 1262 raft_consensus.cc:2454] T d16abd1e360844519831cf81eda9a6e1 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:59.459969 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
I20260621 02:41:59.460659 1770 tablet.cc:1722] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:59.461000 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
F20260621 02:41:59.462581 1553 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 31): 31 CREATE_TABLE default.table_f380223331ea479893e63d4d53570bed
*** Check failure stack trace: ***
I20260621 02:41:59.471115 1741 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.471503 1741 ts_tablet_manager.cc:1397] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.134s user 0.011s sys 0.015s
I20260621 02:41:59.472414 1741 raft_consensus.cc:348] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.472805 1741 raft_consensus.cc:374] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.472944 1741 raft_consensus.cc:729] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.473309 1741 consensus_queue.cc:260] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.480070 1751 raft_consensus.cc:2229] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.481402 1751 pending_rounds.cc:62] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Trying to abort 2 pending ops.
I20260621 02:41:59.481571 1751 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7299111810426347520 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "6ef4cdcf4c9e4db2a776a1b2516c0745" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_3a337887b0124960a4309bf3ff5d2ed5" dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" new_extra_config { } }
I20260621 02:41:59.483402 1751 pending_rounds.cc:68] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299111807599177728 op_type: NO_OP noop_request { }
I20260621 02:41:59.483652 1751 raft_consensus.cc:2866] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260621 02:41:59.483896 1751 raft_consensus.cc:2258] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.479830 1780 tablet.cc:1722] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:41:59.485697 1741 ts_tablet_manager.cc:1428] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260621 02:41:59.486652 1712 raft_consensus.cc:686] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:59.487030 1712 consensus_queue.cc:237] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.488328 1770 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260621 02:41:59.489773 1741 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.490926 1488 catalog_manager.cc:5495] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2). New cstate: current_term: 1 leader_uuid: "6f52030a7bb641f883dba1ffbd912dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } health_report { overall_health: HEALTHY } } }
I20260621 02:41:59.491734 1740 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.491969 1740 ts_tablet_manager.cc:1397] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.007s
I20260621 02:41:59.492537 1769 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260621 02:41:59.493669 1751 ts_tablet_manager.cc:1905] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.493753 1740 raft_consensus.cc:348] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.494125 1740 raft_consensus.cc:374] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.494271 1740 raft_consensus.cc:729] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
@ 0x7ff00c2839ad google::LogMessage::Fail() at ??:0
@ 0x7ff00c28688a google::LogMessage::SendToLog() at ??:0
I20260621 02:41:59.497525 1740 consensus_queue.cc:260] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.501888 1740 ts_tablet_manager.cc:1428] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
@ 0x7ff00c2834de google::LogMessage::Flush() at ??:0
I20260621 02:41:59.505260 1769 tablet.cc:1722] T 475e1e2bcc3d4ac9a6cd03b78f737b66 P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
@ 0x7ff00c2836d1 google::LogMessage::~LogMessage() at ??:0
I20260621 02:41:59.506203 1768 tablet.cc:1722] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260621 02:41:59.506377 1740 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.517540 1740 tablet_bootstrap.cc:654] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.518415 1751 ts_tablet_manager.cc:1918] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.518566 1751 log.cc:1196] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.518987 1741 tablet_bootstrap.cc:654] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.519063 1751 ts_tablet_manager.cc:1939] T 6ef4cdcf4c9e4db2a776a1b2516c0745 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
@ 0x7ff021e21ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260621 02:41:59.520437 1476 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]) successfully deleted
I20260621 02:41:59.520766 1488 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5] alter complete (version 1)
I20260621 02:41:59.521553 1739 tablet_bootstrap.cc:492] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.521716 1739 ts_tablet_manager.cc:1397] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.217s user 0.053s sys 0.096s
I20260621 02:41:59.522866 1739 raft_consensus.cc:348] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.523180 1739 raft_consensus.cc:374] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.523166 1488 master_service.cc:946] ReplaceTablet: received request to replace tablet c8e6eed9c51943bb81997aa8c4d880eb from {username='slave'} at 127.0.0.1:42094
I20260621 02:41:59.523252 1739 raft_consensus.cc:729] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.523577 1739 consensus_queue.cc:260] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.524230 1739 ts_tablet_manager.cc:1428] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260621 02:41:59.525468 1739 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
@ 0x7ff021e20901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260621 02:41:59.527654 1739 tablet_bootstrap.cc:654] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.528640 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d2fc2340c3d4e0d860c91205eaedf68) from {username='slave'} at 127.0.0.1:43882
@ 0x7ff021e2766c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260621 02:41:59.531555 1730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:41:59.531826 1730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
@ 0x7ff021e274e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260621 02:41:59.543303 1488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Sending DeleteTablet for 3 replicas of tablet c8e6eed9c51943bb81997aa8c4d880eb
I20260621 02:41:59.544101 964 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb with delete_type TABLET_DATA_DELETED (replaced by tablet 18a8243272f04644b9b5634181e47257) from {username='slave'} at 127.0.0.1:38350
I20260621 02:41:59.544498 1743 tablet_replica.cc:330] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:41:59.544790 1743 raft_consensus.cc:2229] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.545061 1743 raft_consensus.cc:2258] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.545987 1743 ts_tablet_manager.cc:1905] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.549610 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb with delete_type TABLET_DATA_DELETED (replaced by tablet 18a8243272f04644b9b5634181e47257) from {username='slave'} at 127.0.0.1:35002
I20260621 02:41:59.550547 1744 tablet_replica.cc:330] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:41:59.550827 1744 raft_consensus.cc:2229] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:41:59.551287 1744 raft_consensus.cc:2258] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.552083 1744 ts_tablet_manager.cc:1905] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:41:59.562131 1740 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.562347 1740 ts_tablet_manager.cc:1397] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.002s
I20260621 02:41:59.563321 1740 raft_consensus.cc:348] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.563627 1740 raft_consensus.cc:374] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.563724 1740 raft_consensus.cc:729] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.565850 1712 raft_consensus.cc:482] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.566017 1712 raft_consensus.cc:504] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.567174 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:59.567427 1127 raft_consensus.cc:2454] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.567903 926 leader_election.cc:302] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.568185 1786 raft_consensus.cc:2781] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:59.568289 1786 raft_consensus.cc:482] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:59.568411 1786 raft_consensus.cc:3037] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.570109 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:59.570308 1739 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.570397 1261 raft_consensus.cc:2454] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.570463 1739 ts_tablet_manager.cc:1397] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.004s
I20260621 02:41:59.571322 1744 ts_tablet_manager.cc:1918] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.571445 1744 log.cc:1196] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/c8e6eed9c51943bb81997aa8c4d880eb
I20260621 02:41:59.571302 1739 raft_consensus.cc:348] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.571537 1739 raft_consensus.cc:374] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.571628 1739 raft_consensus.cc:729] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.571892 1744 ts_tablet_manager.cc:1939] T c8e6eed9c51943bb81997aa8c4d880eb P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:41:59.571887 1739 consensus_queue.cc:260] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.572484 1739 ts_tablet_manager.cc:1428] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260621 02:41:59.572791 1739 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.573036 1712 leader_election.cc:288] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:59.575498 1786 raft_consensus.cc:504] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.575816 1740 consensus_queue.cc:260] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.576128 1739 tablet_bootstrap.cc:654] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.576213 1786 leader_election.cc:288] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:41:59.576980 1743 ts_tablet_manager.cc:1918] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.577117 1743 log.cc:1196] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/c8e6eed9c51943bb81997aa8c4d880eb
I20260621 02:41:59.577626 1743 ts_tablet_manager.cc:1939] T c8e6eed9c51943bb81997aa8c4d880eb P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:41:59.577749 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:59.577988 1261 raft_consensus.cc:3037] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.578630 1740 ts_tablet_manager.cc:1428] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20260621 02:41:59.579733 1741 tablet_bootstrap.cc:492] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.579876 1741 ts_tablet_manager.cc:1397] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.090s user 0.015s sys 0.018s
I20260621 02:41:59.580448 1261 raft_consensus.cc:2454] T 1c4d7a76b39841988629f0db75f1f69e P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:59.580595 1741 raft_consensus.cc:348] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.580806 1741 raft_consensus.cc:374] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.580919 1741 raft_consensus.cc:729] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.577229 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4d7a76b39841988629f0db75f1f69e" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:59.581173 1127 raft_consensus.cc:3037] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.581120 1741 consensus_queue.cc:260] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.582396 1786 raft_consensus.cc:482] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.583401 1741 ts_tablet_manager.cc:1428] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260621 02:41:59.583738 1741 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.584235 1127 raft_consensus.cc:2454] T 1c4d7a76b39841988629f0db75f1f69e P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:59.584730 926 leader_election.cc:302] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.585050 1712 raft_consensus.cc:2781] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:59.585227 1712 raft_consensus.cc:686] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:59.585811 1712 consensus_queue.cc:237] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.582567 1786 raft_consensus.cc:504] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.589115 1488 catalog_manager.cc:6565] ReplaceTablet: tablet c8e6eed9c51943bb81997aa8c4d880eb deleted and replaced by tablet 18a8243272f04644b9b5634181e47257
I20260621 02:41:59.589301 1488 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:42094 (request call id 21) took 1177 ms. Trace:
I20260621 02:41:59.589489 1741 tablet_bootstrap.cc:654] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.592224 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a484bc2d4e4488aa3575792b40ec62" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:59.592559 1261 raft_consensus.cc:2454] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.593135 927 leader_election.cc:302] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:59.593552 1777 raft_consensus.cc:2781] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:59.593688 1777 raft_consensus.cc:482] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:59.593848 1777 raft_consensus.cc:3037] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.593748 1488 rpcz_store.cc:276] 0621 02:41:58.412240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0621 02:41:59.523047 (+1110807us) service_pool.cc:227] Handling call
0621 02:41:59.543022 (+ 19975us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.543029 (+ 7us) write_op.cc:454] Released schema lock
0621 02:41:59.589255 (+ 46226us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0621 02:41:59.528879 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0621 02:41:59.528998 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0621 02:41:59.529004 (+ 6us) write_op.cc:435] Acquired schema lock
0621 02:41:59.529007 (+ 3us) tablet.cc:660] Decoding operations
0621 02:41:59.529138 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0621 02:41:59.529153 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0621 02:41:59.529158 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0621 02:41:59.529272 (+ 114us) tablet.cc:699] Row locks acquired
0621 02:41:59.529275 (+ 3us) write_op.cc:260] PREPARE: finished
0621 02:41:59.529318 (+ 43us) write_op.cc:270] Start()
0621 02:41:59.533457 (+ 4139us) write_op.cc:276] Timestamp: P: 1782009719529279 usec, L: 0
0621 02:41:59.533463 (+ 6us) op_driver.cc:331] REPLICATION: starting
0621 02:41:59.533702 (+ 239us) log.cc:842] Serialized 652 byte log entry
0621 02:41:59.537667 (+ 3965us) op_driver.cc:444] REPLICATION: finished
0621 02:41:59.537783 (+ 116us) write_op.cc:301] APPLY: starting
0621 02:41:59.537800 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0621 02:41:59.537849 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0621 02:41:59.537884 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0621 02:41:59.538010 (+ 126us) tablet.cc:1381] finished ApplyRowOperation cycle
0621 02:41:59.538072 (+ 62us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0621 02:41:59.538079 (+ 7us) write_op.cc:312] APPLY: finished
0621 02:41:59.538157 (+ 78us) log.cc:842] Serialized 28 byte log entry
0621 02:41:59.538216 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0621 02:41:59.538238 (+ 22us) write_op.cc:454] Released schema lock
0621 02:41:59.538245 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":66,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":512,"num_ops":2,"prepare.queue_time_us":4589,"prepare.run_cpu_time_us":870,"prepare.run_wall_time_us":4927,"raft.queue_time_us":67,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257,"replication_time_us":4178}]]}
I20260621 02:41:59.595691 1475 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]) successfully deleted
I20260621 02:41:59.596959 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a484bc2d4e4488aa3575792b40ec62" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:41:59.597219 1127 raft_consensus.cc:2454] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:41:59.597900 1786 leader_election.cc:288] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:59.598675 1777 raft_consensus.cc:504] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.599473 1471 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet c8e6eed9c51943bb81997aa8c4d880eb (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]) successfully deleted
I20260621 02:41:59.599895 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a484bc2d4e4488aa3575792b40ec62" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:59.600111 1261 raft_consensus.cc:3037] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
W20260621 02:41:59.600221 1471 catalog_manager.cc:4914] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): alter failed for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]),no further retry: Not found: Tablet not found: 6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.604007 1261 raft_consensus.cc:2454] T 22a484bc2d4e4488aa3575792b40ec62 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
@ 0x7ff00eeadeaf kudu::Thread::SuperviseThread() at ??:0
I20260621 02:41:59.604686 927 leader_election.cc:302] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:59.605073 1786 raft_consensus.cc:2781] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:59.606604 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a484bc2d4e4488aa3575792b40ec62" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:41:59.606858 1127 raft_consensus.cc:3037] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.610067 1127 raft_consensus.cc:2454] T 22a484bc2d4e4488aa3575792b40ec62 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:41:59.610625 1777 leader_election.cc:288] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:41:59.613536 1104 tablet_service.cc:1467] Processing CreateTablet for tablet 18a8243272f04644b9b5634181e47257 (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.614102 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a8243272f04644b9b5634181e47257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.617792 1786 raft_consensus.cc:686] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:41:59.618155 1786 consensus_queue.cc:237] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.618872 964 tablet_service.cc:1467] Processing CreateTablet for tablet 18a8243272f04644b9b5634181e47257 (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:41:59.619417 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a8243272f04644b9b5634181e47257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.621547 1741 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.621729 1741 ts_tablet_manager.cc:1397] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.012s
I20260621 02:41:59.622560 1741 raft_consensus.cc:348] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.622805 1741 raft_consensus.cc:374] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.622882 1741 raft_consensus.cc:729] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.623133 1741 consensus_queue.cc:260] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.623708 1741 ts_tablet_manager.cc:1428] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260621 02:41:59.629086 1740 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:41:59.629489 1488 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af] alter complete (version 2)
I20260621 02:41:59.629665 1741 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:41:59.630785 1740 tablet_bootstrap.cc:654] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.631167 1741 tablet_bootstrap.cc:654] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
@ 0x7ff0121876db start_thread at ??:0
I20260621 02:41:59.641710 1488 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60] alter complete (version 1)
I20260621 02:41:59.645282 1488 catalog_manager.cc:5587] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873) does not have the latest schema for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]). Expected version 1 got 0
W20260621 02:41:59.649773 1476 catalog_manager.cc:4808] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): delete failed for tablet 6ef4cdcf4c9e4db2a776a1b2516c0745 because the tablet was not found. No further retry: Not found: Tablet not found: 6ef4cdcf4c9e4db2a776a1b2516c0745
I20260621 02:41:59.650753 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e6eed9c51943bb81997aa8c4d880eb with delete_type TABLET_DATA_DELETED (replaced by tablet 18a8243272f04644b9b5634181e47257) from {username='slave'} at 127.0.0.1:43882
I20260621 02:41:59.651122 1751 tablet_replica.cc:330] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:41:59.651427 1751 raft_consensus.cc:2229] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:41:59.651707 1751 raft_consensus.cc:2258] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:41:59.652530 1751 ts_tablet_manager.cc:1905] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260621 02:41:59.657612 1488 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7d2fc2340c3d4e0d860c91205eaedf68 consensus state has no leader
I20260621 02:41:59.663296 1237 tablet_service.cc:1467] Processing CreateTablet for tablet 18a8243272f04644b9b5634181e47257 (DEFAULT_TABLE table=default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7ff00b11d61f clone at ??:0
I20260621 02:41:59.672367 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18a8243272f04644b9b5634181e47257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:41:59.683699 1751 ts_tablet_manager.cc:1918] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:41:59.683893 1751 log.cc:1196] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/c8e6eed9c51943bb81997aa8c4d880eb
I20260621 02:41:59.684300 1751 ts_tablet_manager.cc:1939] T c8e6eed9c51943bb81997aa8c4d880eb P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:41:59.687184 1740 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:41:59.687294 1741 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:41:59.687340 1740 ts_tablet_manager.cc:1397] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.058s user 0.015s sys 0.026s
I20260621 02:41:59.687470 1741 ts_tablet_manager.cc:1397] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.027s
I20260621 02:41:59.688228 1741 raft_consensus.cc:348] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.688305 1740 raft_consensus.cc:348] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.688463 1741 raft_consensus.cc:374] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.688541 1740 raft_consensus.cc:374] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.688549 1741 raft_consensus.cc:729] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.688627 1740 raft_consensus.cc:729] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.688898 1740 consensus_queue.cc:260] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.689589 1739 tablet_bootstrap.cc:492] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.689754 1739 ts_tablet_manager.cc:1397] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.117s user 0.017s sys 0.038s
I20260621 02:41:59.690560 1739 raft_consensus.cc:348] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.690796 1739 raft_consensus.cc:374] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.690864 1739 raft_consensus.cc:729] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.691193 1739 consensus_queue.cc:260] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.692737 1740 ts_tablet_manager.cc:1428] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260621 02:41:59.695468 1739 ts_tablet_manager.cc:1428] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260621 02:41:59.695820 1739 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:41:59.700030 1739 tablet_bootstrap.cc:654] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:41:59.701220 1741 consensus_queue.cc:260] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.702180 1741 ts_tablet_manager.cc:1428] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260621 02:41:59.705963 1739 tablet_bootstrap.cc:492] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:41:59.706106 1739 ts_tablet_manager.cc:1397] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.002s
I20260621 02:41:59.706866 1739 raft_consensus.cc:348] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.707082 1739 raft_consensus.cc:374] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:41:59.707159 1739 raft_consensus.cc:729] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:41:59.707409 1739 consensus_queue.cc:260] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:41:59.713757 1739 ts_tablet_manager.cc:1428] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260621 02:41:59.897038 1198 connection.cc:535] server connection from 127.0.0.1:43882 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:41:59.897971 1318 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:41:59.898676 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:44219)
W20260621 02:41:59.900153 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:44219)
W20260621 02:41:59.900105 927 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:41:59.900856 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:44219)
I20260621 02:41:59.907025 1814 raft_consensus.cc:482] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:41:59.907251 1814 raft_consensus.cc:504] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.908388 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e49f47887e044668800410f7a7b72b4" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:41:59.908537 1814 leader_election.cc:288] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:59.908710 1261 raft_consensus.cc:2454] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:59.909093 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e49f47887e044668800410f7a7b72b4" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:41:59.909163 1065 leader_election.cc:302] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:41:59.909376 987 raft_consensus.cc:2454] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 0.
I20260621 02:41:59.921011 1814 raft_consensus.cc:2781] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:41:59.921221 1814 raft_consensus.cc:482] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:41:59.921329 1814 raft_consensus.cc:3037] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.924300 1814 raft_consensus.cc:504] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
I20260621 02:41:59.925415 1814 leader_election.cc:288] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:41:59.925534 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e49f47887e044668800410f7a7b72b4" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:41:59.925530 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e49f47887e044668800410f7a7b72b4" candidate_uuid: "6f52030a7bb641f883dba1ffbd912dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:41:59.925765 987 raft_consensus.cc:3037] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.925777 1261 raft_consensus.cc:3037] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:41:59.928526 1261 raft_consensus.cc:2454] T 5e49f47887e044668800410f7a7b72b4 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:59.928572 987 raft_consensus.cc:2454] T 5e49f47887e044668800410f7a7b72b4 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f52030a7bb641f883dba1ffbd912dba in term 1.
I20260621 02:41:59.929025 1062 leader_election.cc:302] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:41:59.930286 1814 raft_consensus.cc:2781] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:41:59.930462 1814 raft_consensus.cc:686] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Becoming Leader. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Running, Role: LEADER
I20260621 02:41:59.930727 1814 consensus_queue.cc:237] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } }
W20260621 02:42:00.062438 1765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:00.062737 1765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:00.062842 1765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:00.071162 1765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:00.071273 1765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:00.071357 1765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:00.071447 1765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:00.081462 1765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=41917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:00.082823 1765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:00.084656 1765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:00.097752 1826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:00.097858 1824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:00.097834 1823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:00.098665 1765 server_base.cc:1034] running on GCE node
I20260621 02:42:00.099546 1765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:00.100951 1765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:00.102172 1765 hybrid_clock.cc:648] HybridClock initialized: now 1782009720102102 us; error 46 us; skew 500 ppm
I20260621 02:42:00.102540 1765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:00.104986 1765 webserver.cc:460] Webserver started at http://127.0.97.61:41917/ using document root <none> and password file <none>
I20260621 02:42:00.105720 1765 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:00.105834 1765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:00.110905 1765 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260621 02:42:00.114180 1832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:00.115628 1765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260621 02:42:00.115832 1765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:00.116824 1765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:00.131721 1765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:00.132730 1765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:00.133060 1765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:00.137391 1839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:00.137588 1839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.138394 1839 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:00.139781 787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260621 02:42:00.141299 787 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:00.141523 787 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:00.141651 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:00.141948 1839 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260621 02:42:00.153481 1765 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:35493
I20260621 02:42:00.153510 1887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:35493 every 8 connection(s)
I20260621 02:42:00.155258 1765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
I20260621 02:42:00.160444 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 1765
I20260621 02:42:00.163666 1888 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:00.167938 1888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap starting.
I20260621 02:42:00.183830 1888 log.cc:824] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:00.207839 1893 raft_consensus.cc:482] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:00.208083 1893 raft_consensus.cc:504] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.209729 1893 leader_election.cc:288] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:00.210150 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fc2340c3d4e0d860c91205eaedf68" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:42:00.210305 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fc2340c3d4e0d860c91205eaedf68" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:42:00.210433 1261 raft_consensus.cc:2454] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:00.210556 1127 raft_consensus.cc:2454] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:00.211014 926 leader_election.cc:302] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:42:00.211462 1893 raft_consensus.cc:2781] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:42:00.211644 1893 raft_consensus.cc:482] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:00.211796 1893 raft_consensus.cc:3037] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.214629 1893 raft_consensus.cc:504] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.215874 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fc2340c3d4e0d860c91205eaedf68" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:42:00.215880 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d2fc2340c3d4e0d860c91205eaedf68" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:42:00.216105 1127 raft_consensus.cc:3037] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.216106 1261 raft_consensus.cc:3037] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.217502 1893 leader_election.cc:288] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:00.218348 1261 raft_consensus.cc:2454] T 7d2fc2340c3d4e0d860c91205eaedf68 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:00.218710 1127 raft_consensus.cc:2454] T 7d2fc2340c3d4e0d860c91205eaedf68 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:00.218858 927 leader_election.cc:302] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:42:00.219161 1893 raft_consensus.cc:2781] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:42:00.219800 1893 raft_consensus.cc:686] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:42:00.220361 1893 consensus_queue.cc:237] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.222021 1038 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:00.230487 1310 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:00.255645 1888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap replayed 1/1 log segments. Stats: ops{read=81 overwritten=0 applied=81 ignored=0} inserts{seen=56 ignored=0} mutations{seen=68 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 02:42:00.256155 1888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap complete.
I20260621 02:42:00.264159 1888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.265085 1888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Initialized, Role: FOLLOWER
I20260621 02:42:00.265815 1888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 81, Last appended: 2.81, Last appended by leader: 81, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.266674 1897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:00.267048 1897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:00.267791 1888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:00.288810 1912 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:00.289011 1912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: loading cluster ID for follower catalog manager: success
I20260621 02:42:00.292196 1893 consensus_queue.cc:1035] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.294654 1912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: acquiring CA information for follower catalog manager: success
I20260621 02:42:00.283406 1765 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:00.298381 1765 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:00.300966 1853 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:57727; Asking this server to re-register.
I20260621 02:42:00.306906 1894 consensus_queue.cc:1035] T d16abd1e360844519831cf81eda9a6e1 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.307940 1912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:00.311182 1310 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:00.321002 1853 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:00.326475 1852 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:55273; Asking this server to re-register.
I20260621 02:42:00.328011 1038 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:00.329223 1176 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:00.329972 1852 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:00.335651 1852 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:53069; Asking this server to re-register.
I20260621 02:42:00.336655 1176 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:00.340548 1852 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:00.381762 1814 consensus_queue.cc:1035] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.388744 1746 consensus_queue.cc:1035] T 908e00c0865749d2b19417e336888311 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.499400 1893 raft_consensus.cc:482] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:00.499635 1893 raft_consensus.cc:504] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.500288 1893 leader_election.cc:288] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:00.500245 1894 consensus_queue.cc:1035] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.501739 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a8243272f04644b9b5634181e47257" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:42:00.501987 1126 raft_consensus.cc:2454] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:00.502961 926 leader_election.cc:302] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:42:00.503451 1893 raft_consensus.cc:2781] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:42:00.503590 1893 raft_consensus.cc:482] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:00.503695 1893 raft_consensus.cc:3037] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.507797 1893 raft_consensus.cc:504] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.508513 1893 leader_election.cc:288] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:00.511482 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a8243272f04644b9b5634181e47257" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:42:00.511886 1261 raft_consensus.cc:2454] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:00.513561 1126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a8243272f04644b9b5634181e47257" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:42:00.513779 1126 raft_consensus.cc:3037] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.515141 1261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18a8243272f04644b9b5634181e47257" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:42:00.515367 1261 raft_consensus.cc:3037] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:00.516623 1126 raft_consensus.cc:2454] T 18a8243272f04644b9b5634181e47257 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:00.517102 926 leader_election.cc:302] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:42:00.518162 1261 raft_consensus.cc:2454] T 18a8243272f04644b9b5634181e47257 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:00.517426 1893 raft_consensus.cc:2781] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:42:00.521030 1893 raft_consensus.cc:686] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:42:00.521297 1893 consensus_queue.cc:237] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } }
I20260621 02:42:00.522017 1924 consensus_queue.cc:1035] T 1c4d7a76b39841988629f0db75f1f69e P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.584908 1924 consensus_queue.cc:1035] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.591190 1924 consensus_queue.cc:1035] T 22a484bc2d4e4488aa3575792b40ec62 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.656635 1929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:00.656900 1929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.657582 1929 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:00.660588 787 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:00.666172 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 3 candidate_status { last_received { term: 2 index: 105 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:42:00.666814 1863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 2.
I20260621 02:42:00.667443 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:00.667773 1929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260621 02:42:00.667902 1929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:00.668021 1929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 2 FOLLOWER]: Advancing to term 3
I20260621 02:42:00.671030 1929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.671727 1929 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
I20260621 02:42:00.672967 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 3 candidate_status { last_received { term: 2 index: 105 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c"
I20260621 02:42:00.673233 1863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 2 FOLLOWER]: Advancing to term 3
W20260621 02:42:00.673715 787 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:00.678311 1863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 3.
I20260621 02:42:00.678834 787 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:00.679190 1929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Leader election won for term 3
I20260621 02:42:00.679702 1929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 LEADER]: Becoming Leader. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Running, Role: LEADER
I20260621 02:42:00.680013 1929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 2.105, Last appended by leader: 105, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:00.681509 1933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 3 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:00.681929 1933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:00.682701 1935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:00.741927 1814 consensus_queue.cc:1035] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:00.747444 1746 consensus_queue.cc:1035] T 5e49f47887e044668800410f7a7b72b4 P 6f52030a7bb641f883dba1ffbd912dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:01.062445 1863 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Refusing update from remote peer 5d142d25b86d4ad7935e806b7ebe8599: Log matching property violated. Preceding OpId in replica: term: 2 index: 81. Preceding OpId from leader: term: 3 index: 106. (index mismatch)
I20260621 02:42:01.063271 1929 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 81, Time since last communication: 0.000s
I20260621 02:42:01.074501 1939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 3 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:01.074875 1939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:01.076534 1939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:01.076797 1939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:01.087357 1947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:01.087862 1947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
W20260621 02:42:01.089089 787 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 -> Peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Couldn't send request to peer 09161df32dff4fa18f1926765ea191d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:42:01.103127 1893 consensus_queue.cc:1035] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:01.108700 1893 consensus_queue.cc:1035] T 7d2fc2340c3d4e0d860c91205eaedf68 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260621 02:42:01.273964 786 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cd534990473b46eda79b629c9475d1e2 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd534990473b46eda79b629c9475d1e2 consensus state has no leader
I20260621 02:42:01.302326 1935 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:01.302742 1935 catalog_manager.cc:669] Loaded metadata for table default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:01.303097 1935 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:01.303480 1935 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:01.303807 1935 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:01.304171 1935 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:01.304533 1935 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:01.304886 1935 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:01.305478 1935 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:01.306221 1935 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:01.306583 1935 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:01.307149 1935 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:01.307488 1935 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:01.307842 1935 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:01.308204 1935 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:01.310299 1935 tablet_loader.cc:96] loaded metadata for tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:01.310654 1935 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:01.310984 1935 tablet_loader.cc:96] loaded metadata for tablet 1c4d7a76b39841988629f0db75f1f69e (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:01.311376 1935 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:01.311910 1935 tablet_loader.cc:96] loaded metadata for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:01.312636 1935 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:01.312948 1935 tablet_loader.cc:96] loaded metadata for tablet 5e49f47887e044668800410f7a7b72b4 (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:01.313244 1935 tablet_loader.cc:96] loaded metadata for tablet 67321be37d724469b620707de07c7f03 (table default.table_4e260ee413ad41378c547ad6650740fd [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:01.313726 1935 tablet_loader.cc:96] loaded metadata for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:01.314262 1935 tablet_loader.cc:96] loaded metadata for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:01.314569 1935 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:01.315017 1935 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:01.315429 1935 tablet_loader.cc:96] loaded metadata for tablet a50603036c5046e8aba135c3787f890a (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:01.316206 1935 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:01.316835 1935 tablet_loader.cc:96] loaded metadata for tablet fb30ab4457aa45858a6e722be50eb43b (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:01.317418 1935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:01.318769 1935 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:01.318872 1935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:01.320766 1935 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:01.322228 1935 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Loaded TSK: 0
I20260621 02:42:01.322926 1935 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:01.324141 1935 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:01.325287 1935 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 31
I20260621 02:42:01.359663 793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_3548a6e62b27484d8fa771f8688ca8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.359750 794 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_608c53f32c054ee49c55bcf8ee3a7e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.360342 795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_f380223331ea479893e63d4d53570bed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.360672 797 master_service.cc:946] ReplaceTablet: received request to replace tablet 08a8a4507edf43faac392c2ac70e852f from {username='slave'} at 127.0.0.1:47520
I20260621 02:42:01.360775 791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_6217ff360f914564a1fee8cacc9c1e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.360987 798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_5ca503a3c4ba46a6bda089bf52d0f837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.361433 796 master_service.cc:946] ReplaceTablet: received request to replace tablet 6f1bd2ccc74f4a3f856c56ad73602bfe from {username='slave'} at 127.0.0.1:47520
I20260621 02:42:01.362315 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_24e7a08d72a94d58a56750b388a7273a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.362787 799 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_8b85797f61204810a499ef6b970dca59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.363271 800 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_522feae8f40d42578d1c405f347589bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.366935 874 catalog_manager.cc:2709] Deleting table default.table_608c53f32c054ee49c55bcf8ee3a7e46 [id=b29c379f823c425bb8c96525bd0668da] in response to Hive Metastore notification log event 32
W20260621 02:42:01.367290 874 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 32 DROP_TABLE default.table_608c53f32c054ee49c55bcf8ee3a7e46: Not found: the table does not exist: table_id: "b29c379f823c425bb8c96525bd0668da" table_name: "default.table_608c53f32c054ee49c55bcf8ee3a7e46"
I20260621 02:42:01.369072 797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 08a8a4507edf43faac392c2ac70e852f
I20260621 02:42:01.369558 797 catalog_manager.cc:6565] ReplaceTablet: tablet 08a8a4507edf43faac392c2ac70e852f deleted and replaced by tablet dd3f3dc9ba764ccba687e4ef4773c6cd
I20260621 02:42:01.369871 964 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a8a4507edf43faac392c2ac70e852f with delete_type TABLET_DATA_DELETED (replaced by tablet dd3f3dc9ba764ccba687e4ef4773c6cd) from {username='slave'} at 127.0.0.1:49528
I20260621 02:42:01.369937 797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_0edb9612fcce47c99862ea3c6c864569"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.372360 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a8a4507edf43faac392c2ac70e852f with delete_type TABLET_DATA_DELETED (replaced by tablet dd3f3dc9ba764ccba687e4ef4773c6cd) from {username='slave'} at 127.0.0.1:35408
I20260621 02:42:01.372592 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet 08a8a4507edf43faac392c2ac70e852f with delete_type TABLET_DATA_DELETED (replaced by tablet dd3f3dc9ba764ccba687e4ef4773c6cd) from {username='slave'} at 127.0.0.1:38742
I20260621 02:42:01.379943 796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 6f1bd2ccc74f4a3f856c56ad73602bfe
I20260621 02:42:01.380605 796 catalog_manager.cc:6565] ReplaceTablet: tablet 6f1bd2ccc74f4a3f856c56ad73602bfe deleted and replaced by tablet c09f475cc8fc487aba84bdba81d6ea97
I20260621 02:42:01.381227 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe with delete_type TABLET_DATA_DELETED (replaced by tablet c09f475cc8fc487aba84bdba81d6ea97) from {username='slave'} at 127.0.0.1:35408
I20260621 02:42:01.381116 796 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47520:
name: "default.Table_66ba19cef5dc4906ad2b7f2946cac9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:01.382252 969 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe with delete_type TABLET_DATA_DELETED (replaced by tablet c09f475cc8fc487aba84bdba81d6ea97) from {username='slave'} at 127.0.0.1:49528
I20260621 02:42:01.382656 1238 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f1bd2ccc74f4a3f856c56ad73602bfe with delete_type TABLET_DATA_DELETED (replaced by tablet c09f475cc8fc487aba84bdba81d6ea97) from {username='slave'} at 127.0.0.1:38742
I20260621 02:42:01.387848 1955 tablet_replica.cc:330] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:42:01.388427 1953 tablet_replica.cc:330] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:42:01.388720 1953 raft_consensus.cc:2229] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:01.388737 1955 raft_consensus.cc:2229] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:42:01.389003 1953 raft_consensus.cc:2258] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:01.389026 1954 tablet_replica.cc:330] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:42:01.389241 1954 raft_consensus.cc:2229] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:01.389549 1954 raft_consensus.cc:2258] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:01.389674 1953 ts_tablet_manager.cc:1905] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.390115 1954 ts_tablet_manager.cc:1905] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.392105 1109 tablet_service.cc:1467] Processing CreateTablet for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (DEFAULT_TABLE table=default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.392311 1237 tablet_service.cc:1467] Processing CreateTablet for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (DEFAULT_TABLE table=default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.392486 1109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3f3dc9ba764ccba687e4ef4773c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:42:01.392688 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3f3dc9ba764ccba687e4ef4773c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:42:01.398530 964 tablet_service.cc:1467] Processing CreateTablet for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (DEFAULT_TABLE table=default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.406634 1954 ts_tablet_manager.cc:1918] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260621 02:42:01.406813 1955 raft_consensus.cc:2258] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:01.408034 1955 ts_tablet_manager.cc:1905] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.411348 874 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:01.411707 874 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:01.412819 874 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:01.413074 874 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:01.413147 874 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
I20260621 02:42:01.413604 964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3f3dc9ba764ccba687e4ef4773c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
*** Check failure stack trace: ***
I20260621 02:42:01.415441 1954 log.cc:1196] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/08a8a4507edf43faac392c2ac70e852f
I20260621 02:42:01.416020 1954 ts_tablet_manager.cc:1939] T 08a8a4507edf43faac392c2ac70e852f P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
@ 0x7f88bf6db9ad google::LogMessage::Fail() at ??:0
I20260621 02:42:01.416728 1953 ts_tablet_manager.cc:1918] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260621 02:42:01.416851 1953 log.cc:1196] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/08a8a4507edf43faac392c2ac70e852f
I20260621 02:42:01.417303 1953 ts_tablet_manager.cc:1939] T 08a8a4507edf43faac392c2ac70e852f P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:42:01.417299 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:42:01.417459 1954 tablet_replica.cc:330] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:42:01.417711 1954 raft_consensus.cc:2229] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:01.417922 1954 raft_consensus.cc:2258] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:01.418392 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
@ 0x7f88bf6de88a google::LogMessage::SendToLog() at ??:0
I20260621 02:42:01.418583 1954 ts_tablet_manager.cc:1905] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.418682 1953 tablet_replica.cc:330] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:42:01.418886 1953 raft_consensus.cc:2229] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:01.419071 1953 raft_consensus.cc:2258] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f88bf6db4de google::LogMessage::Flush() at ??:0
I20260621 02:42:01.420234 1953 ts_tablet_manager.cc:1905] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.424043 1950 consensus_queue.cc:1035] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:01.426523 1954 ts_tablet_manager.cc:1918] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:01.426699 1954 log.cc:1196] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/6f1bd2ccc74f4a3f856c56ad73602bfe
I20260621 02:42:01.427212 1954 ts_tablet_manager.cc:1939] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:42:01.415014 1959 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:42:01.428524 786 catalog_manager.cc:4841] TS 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873): tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:42:01.428721 1953 ts_tablet_manager.cc:1918] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:01.428853 1953 log.cc:1196] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/6f1bd2ccc74f4a3f856c56ad73602bfe
I20260621 02:42:01.429230 1953 ts_tablet_manager.cc:1939] T 6f1bd2ccc74f4a3f856c56ad73602bfe P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:42:01.430546 1959 tablet_bootstrap.cc:654] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.435868 969 tablet_service.cc:1467] Processing CreateTablet for tablet c09f475cc8fc487aba84bdba81d6ea97 (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.436113 1237 tablet_service.cc:1467] Processing CreateTablet for tablet c09f475cc8fc487aba84bdba81d6ea97 (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.436283 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c09f475cc8fc487aba84bdba81d6ea97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:42:01.436507 1237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c09f475cc8fc487aba84bdba81d6ea97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 02:42:01.436527 1104 tablet_service.cc:1467] Processing CreateTablet for tablet c09f475cc8fc487aba84bdba81d6ea97 (DEFAULT_TABLE table=default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 02:42:01.437067 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c09f475cc8fc487aba84bdba81d6ea97. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f88bf6db6d1 google::LogMessage::~LogMessage() at ??:0
I20260621 02:42:01.444825 1959 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:42:01.445013 1959 ts_tablet_manager.cc:1397] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260621 02:42:01.446099 1959 raft_consensus.cc:348] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.446436 1959 raft_consensus.cc:374] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.446542 1959 raft_consensus.cc:729] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.446820 1959 consensus_queue.cc:260] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.447957 1960 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:42:01.449697 1959 ts_tablet_manager.cc:1428] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260621 02:42:01.450847 1959 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc: Bootstrap starting.
I20260621 02:42:01.451678 1960 tablet_bootstrap.cc:654] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.452368 1959 tablet_bootstrap.cc:654] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.458349 784 catalog_manager.cc:4841] TS 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793): tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:42:01.459962 1963 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:42:01.463263 1963 tablet_bootstrap.cc:654] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.467751 1893 consensus_queue.cc:1035] T 18a8243272f04644b9b5634181e47257 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:01.468272 1959 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc: No bootstrap required, opened a new log
I20260621 02:42:01.468436 1959 ts_tablet_manager.cc:1397] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260621 02:42:01.469295 1959 raft_consensus.cc:348] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.469570 1959 raft_consensus.cc:374] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.469646 1959 raft_consensus.cc:729] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.469887 1959 consensus_queue.cc:260] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
@ 0x7f88d5279ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260621 02:42:01.475126 1959 ts_tablet_manager.cc:1428] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260621 02:42:01.476938 1955 ts_tablet_manager.cc:1918] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260621 02:42:01.477097 1955 log.cc:1196] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/08a8a4507edf43faac392c2ac70e852f
I20260621 02:42:01.478334 1963 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:42:01.478525 1963 ts_tablet_manager.cc:1397] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260621 02:42:01.479626 1963 raft_consensus.cc:348] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.479964 1963 raft_consensus.cc:374] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.480091 1963 raft_consensus.cc:729] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.480406 1963 consensus_queue.cc:260] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.481174 1963 ts_tablet_manager.cc:1428] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260621 02:42:01.481662 1963 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e: Bootstrap starting.
I20260621 02:42:01.483722 1963 tablet_bootstrap.cc:654] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.501741 1955 ts_tablet_manager.cc:1939] T 08a8a4507edf43faac392c2ac70e852f P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:42:01.503039 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 08a8a4507edf43faac392c2ac70e852f (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]) successfully deleted
I20260621 02:42:01.503389 1955 tablet_replica.cc:330] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:42:01.503626 1955 raft_consensus.cc:2229] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:42:01.503933 1955 raft_consensus.cc:2258] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:01.504633 1955 ts_tablet_manager.cc:1905] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:01.509315 1977 tablet.cc:1722] T 67321be37d724469b620707de07c7f03 P 6f52030a7bb641f883dba1ffbd912dba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:42:01.512226 1960 tablet_bootstrap.cc:492] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:42:01.512398 1960 ts_tablet_manager.cc:1397] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.000s
I20260621 02:42:01.513463 1960 raft_consensus.cc:348] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.513793 1960 raft_consensus.cc:374] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.513901 1960 raft_consensus.cc:729] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.514174 1960 consensus_queue.cc:260] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.514936 1960 ts_tablet_manager.cc:1428] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
@ 0x7f88d5278901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260621 02:42:01.522598 1960 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba: Bootstrap starting.
I20260621 02:42:01.526437 1960 tablet_bootstrap.cc:654] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba: Neither blocks nor log segments found. Creating new log.
I20260621 02:42:01.527469 1978 tablet.cc:1722] T 67321be37d724469b620707de07c7f03 P 35b23c9f06314e4abf6d8aff8989e73e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:42:01.528820 1963 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e: No bootstrap required, opened a new log
I20260621 02:42:01.529014 1963 ts_tablet_manager.cc:1397] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.031s
I20260621 02:42:01.529978 1963 raft_consensus.cc:348] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.530222 1963 raft_consensus.cc:374] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.530299 1963 raft_consensus.cc:729] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.530542 1963 consensus_queue.cc:260] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.531222 1963 ts_tablet_manager.cc:1428] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260621 02:42:01.531813 1979 tablet.cc:1722] T 67321be37d724469b620707de07c7f03 P a2d4d8ec6f9845f5bbfca1390740aedc: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260621 02:42:01.544159 1960 tablet_bootstrap.cc:492] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba: No bootstrap required, opened a new log
I20260621 02:42:01.544180 1955 ts_tablet_manager.cc:1918] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:01.544327 1960 ts_tablet_manager.cc:1397] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260621 02:42:01.544375 1955 log.cc:1196] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/6f1bd2ccc74f4a3f856c56ad73602bfe
I20260621 02:42:01.544858 1955 ts_tablet_manager.cc:1939] T 6f1bd2ccc74f4a3f856c56ad73602bfe P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
@ 0x7f88d527f66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260621 02:42:01.545156 1960 raft_consensus.cc:348] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.545447 1960 raft_consensus.cc:374] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 02:42:01.545524 1960 raft_consensus.cc:729] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f52030a7bb641f883dba1ffbd912dba, State: Initialized, Role: FOLLOWER
I20260621 02:42:01.546061 787 catalog_manager.cc:4841] TS a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259): tablet 6f1bd2ccc74f4a3f856c56ad73602bfe (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]) successfully deleted
I20260621 02:42:01.545820 1960 consensus_queue.cc:260] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.546655 1960 ts_tablet_manager.cc:1428] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
@ 0x7f88d527f4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f88c2305eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f88c55df6db start_thread at ??:0
@ 0x7f88be57561f clone at ??:0
I20260621 02:42:01.756235 1950 raft_consensus.cc:482] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:01.756490 1950 raft_consensus.cc:504] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
W20260621 02:42:01.756690 1315 connection.cc:535] client connection to 127.0.97.60:39755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260621 02:42:01.757256 1950 leader_election.cc:288] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
W20260621 02:42:01.757395 1315 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.60:39755)
W20260621 02:42:01.757804 1315 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.60:39755)
W20260621 02:42:01.758200 1315 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:39755)
W20260621 02:42:01.759406 1315 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:39755)
I20260621 02:42:01.759745 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c09f475cc8fc487aba84bdba81d6ea97" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:42:01.759990 1127 raft_consensus.cc:2454] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:01.760285 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c09f475cc8fc487aba84bdba81d6ea97" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" is_pre_election: true
I20260621 02:42:01.760485 926 leader_election.cc:302] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:42:01.760519 1262 raft_consensus.cc:2454] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 0.
I20260621 02:42:01.760793 1950 raft_consensus.cc:2781] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:42:01.760887 1950 raft_consensus.cc:482] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:01.761000 1950 raft_consensus.cc:3037] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.763490 1950 raft_consensus.cc:504] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.764117 1950 leader_election.cc:288] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Requested vote from peers 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873), a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:01.764655 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c09f475cc8fc487aba84bdba81d6ea97" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:42:01.764897 1127 raft_consensus.cc:3037] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.765053 1262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c09f475cc8fc487aba84bdba81d6ea97" candidate_uuid: "35b23c9f06314e4abf6d8aff8989e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc"
I20260621 02:42:01.765278 1262 raft_consensus.cc:3037] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.767211 1127 raft_consensus.cc:2454] T c09f475cc8fc487aba84bdba81d6ea97 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:01.767249 1262 raft_consensus.cc:2454] T c09f475cc8fc487aba84bdba81d6ea97 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35b23c9f06314e4abf6d8aff8989e73e in term 1.
I20260621 02:42:01.767606 926 leader_election.cc:302] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba; no voters:
I20260621 02:42:01.767948 1950 raft_consensus.cc:2781] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:42:01.768152 1950 raft_consensus.cc:686] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Becoming Leader. State: Replica: 35b23c9f06314e4abf6d8aff8989e73e, State: Running, Role: LEADER
I20260621 02:42:01.768417 1950 consensus_queue.cc:237] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.797348 1781 raft_consensus.cc:482] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:01.797627 1781 raft_consensus.cc:504] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.798306 1781 leader_election.cc:288] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:01.798960 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3f3dc9ba764ccba687e4ef4773c6cd" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e" is_pre_election: true
I20260621 02:42:01.798939 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3f3dc9ba764ccba687e4ef4773c6cd" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba" is_pre_election: true
I20260621 02:42:01.799197 987 raft_consensus.cc:2454] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:42:01.799223 1127 raft_consensus.cc:2454] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 0.
I20260621 02:42:01.799687 1196 leader_election.cc:302] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35b23c9f06314e4abf6d8aff8989e73e, 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:42:01.799986 1781 raft_consensus.cc:2781] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 02:42:01.800128 1781 raft_consensus.cc:482] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:01.800243 1781 raft_consensus.cc:3037] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.802610 1781 raft_consensus.cc:504] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.803462 1781 leader_election.cc:288] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Requested vote from peers 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793), 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:01.803941 1127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3f3dc9ba764ccba687e4ef4773c6cd" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f52030a7bb641f883dba1ffbd912dba"
I20260621 02:42:01.804176 987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3f3dc9ba764ccba687e4ef4773c6cd" candidate_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35b23c9f06314e4abf6d8aff8989e73e"
I20260621 02:42:01.804253 1127 raft_consensus.cc:3037] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.804386 987 raft_consensus.cc:3037] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 0 FOLLOWER]: Advancing to term 1
I20260621 02:42:01.806365 1127 raft_consensus.cc:2454] T dd3f3dc9ba764ccba687e4ef4773c6cd P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:42:01.806385 987 raft_consensus.cc:2454] T dd3f3dc9ba764ccba687e4ef4773c6cd P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2d4d8ec6f9845f5bbfca1390740aedc in term 1.
I20260621 02:42:01.806813 1198 leader_election.cc:302] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f52030a7bb641f883dba1ffbd912dba, a2d4d8ec6f9845f5bbfca1390740aedc; no voters:
I20260621 02:42:01.807152 1781 raft_consensus.cc:2781] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Leader election won for term 1
I20260621 02:42:01.807498 1781 raft_consensus.cc:686] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Becoming Leader. State: Replica: a2d4d8ec6f9845f5bbfca1390740aedc, State: Running, Role: LEADER
I20260621 02:42:01.807848 1781 consensus_queue.cc:237] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 } } peers { permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 } } peers { permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 } }
I20260621 02:42:01.922120 1996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:01.922325 1996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:01.924121 1996 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:01.925168 1836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:01.927039 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:01.927309 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:01.927472 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:01.927814 1996 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260621 02:42:02.544929 2004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:02.545151 2004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:02.545818 2004 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:02.548134 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:02.548312 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:02.548431 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:02.548717 2004 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260621 02:42:02.563622 1950 consensus_queue.cc:1035] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:02.569073 1924 consensus_queue.cc:1035] T c09f475cc8fc487aba84bdba81d6ea97 P 35b23c9f06314e4abf6d8aff8989e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" member_type: VOTER last_known_addr { host: "127.0.97.3" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:02.820042 1781 consensus_queue.cc:1035] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" member_type: VOTER last_known_addr { host: "127.0.97.2" port: 42873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:02.827061 1781 consensus_queue.cc:1035] T dd3f3dc9ba764ccba687e4ef4773c6cd P a2d4d8ec6f9845f5bbfca1390740aedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" member_type: VOTER last_known_addr { host: "127.0.97.1" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 02:42:03.467922 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--webserver_interface=127.0.97.60
--webserver_port=39369
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260621 02:42:03.517656 2020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:03.517889 2020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:03.518581 2020 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:03.520998 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:03.521227 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:03.521384 1833 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:03.521642 2020 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260621 02:42:03.818104 2019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:03.818481 2019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:03.818621 2019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:03.826699 2019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:03.826846 2019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:03.826959 2019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:03.827069 2019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:03.840076 2019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=39369
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:03.841545 2019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:03.843276 2019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:03.855211 2033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:03.855259 2036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:03.855319 2034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:03.856583 2019 server_base.cc:1034] running on GCE node
I20260621 02:42:03.857558 2019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:03.859202 2019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:03.860525 2019 hybrid_clock.cc:648] HybridClock initialized: now 1782009723860457 us; error 34 us; skew 500 ppm
I20260621 02:42:03.860935 2019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:03.863607 2019 webserver.cc:460] Webserver started at http://127.0.97.60:39369/ using document root <none> and password file <none>
I20260621 02:42:03.864387 2019 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:03.864558 2019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:03.871062 2019 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260621 02:42:03.874450 2042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:03.876170 2019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260621 02:42:03.876426 2019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:03.877657 2019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:03.913012 2019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:03.914137 2019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:03.914461 2019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:03.936779 2019 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:39755
I20260621 02:42:03.936813 2095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:39755 every 8 connection(s)
I20260621 02:42:03.938436 2019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
I20260621 02:42:03.945292 2096 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:03.947350 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2019
I20260621 02:42:03.949604 2096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap starting.
I20260621 02:42:03.972705 2096 log.cc:824] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:04.058122 2096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap replayed 1/1 log segments. Stats: ops{read=111 overwritten=0 applied=111 ignored=0} inserts{seen=74 ignored=0} mutations{seen=93 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 02:42:04.058689 2096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap complete.
I20260621 02:42:04.066582 2096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:04.067764 2096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Initialized, Role: FOLLOWER
I20260621 02:42:04.068516 2096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 111, Last appended: 3.111, Last appended by leader: 111, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:04.069448 2100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:04.069768 2100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:04.070595 2096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:04.083896 2019 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:04.094378 2019 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:04.095304 2114 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:04.095435 2114 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: loading cluster ID for follower catalog manager: success
I20260621 02:42:04.099488 2114 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: acquiring CA information for follower catalog manager: success
I20260621 02:42:04.102283 2114 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:04.217984 1036 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:04.223198 2061 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:46381; Asking this server to re-register.
I20260621 02:42:04.224315 1036 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:04.226307 2061 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:04.339515 1174 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:04.341547 2061 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:55077; Asking this server to re-register.
I20260621 02:42:04.342196 1174 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:04.343817 2061 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:04.393064 1308 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:04.395536 2061 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:48739; Asking this server to re-register.
I20260621 02:42:04.396267 1308 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:04.398288 2061 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:04.508090 2100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:04.508333 2100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:04.510133 2100 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:04.511087 2048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:04.512930 2048 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:04.516878 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 4 candidate_status { last_received { term: 3 index: 111 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:42:04.517184 1863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 3.
I20260621 02:42:04.517841 2048 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:04.518262 2100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260621 02:42:04.518427 2100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:04.518535 2100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 3 FOLLOWER]: Advancing to term 4
I20260621 02:42:04.522864 2100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:04.523579 2100 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
I20260621 02:42:04.524542 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 4 candidate_status { last_received { term: 3 index: 111 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c"
I20260621 02:42:04.524796 1863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 3 FOLLOWER]: Advancing to term 4
W20260621 02:42:04.525038 2048 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:04.526793 1863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d142d25b86d4ad7935e806b7ebe8599 in term 4.
I20260621 02:42:04.527244 2048 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:04.527563 2100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Leader election won for term 4
I20260621 02:42:04.528069 2100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 LEADER]: Becoming Leader. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Running, Role: LEADER
I20260621 02:42:04.528527 2100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 3.111, Last appended by leader: 111, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:04.531394 2126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 4 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:04.531749 2126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:04.532425 2128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:04.535584 2128 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:04.536067 2128 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:04.536337 2128 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:04.536621 2128 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:04.536871 2128 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:04.537142 2128 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:04.537483 2128 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:04.537789 2128 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:04.538175 2128 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:04.538661 2128 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:04.538908 2128 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:04.539407 2128 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:04.539690 2128 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:04.539986 2128 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:04.540303 2128 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:04.543008 2128 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:04.543288 2128 tablet_loader.cc:96] loaded metadata for tablet 1c4d7a76b39841988629f0db75f1f69e (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:04.543511 2128 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:04.543870 2128 tablet_loader.cc:96] loaded metadata for tablet 260404e813714081b78847d874de6c38 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:04.544744 2128 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:04.545007 2128 tablet_loader.cc:96] loaded metadata for tablet 5e49f47887e044668800410f7a7b72b4 (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:04.545253 2128 tablet_loader.cc:96] loaded metadata for tablet 67321be37d724469b620707de07c7f03 (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:04.546124 2128 tablet_loader.cc:96] loaded metadata for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:04.546452 2128 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:04.546828 2128 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:04.547181 2128 tablet_loader.cc:96] loaded metadata for tablet a50603036c5046e8aba135c3787f890a (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:04.547735 2128 tablet_loader.cc:96] loaded metadata for tablet c09f475cc8fc487aba84bdba81d6ea97 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:04.548305 2128 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:04.548671 2128 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:04.549202 2128 tablet_loader.cc:96] loaded metadata for tablet fb30ab4457aa45858a6e722be50eb43b (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:04.549535 2128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:04.551258 2128 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:04.551337 2128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:04.553272 2128 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:04.554780 2128 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Loaded TSK: 0
I20260621 02:42:04.555735 2128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:04.557109 2128 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:04.558527 2128 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:04.582710 2060 master_service.cc:946] ReplaceTablet: received request to replace tablet fb30ab4457aa45858a6e722be50eb43b from {username='slave'} at 127.0.0.1:44554
I20260621 02:42:04.584069 2052 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_55949c61dce74206ba47a1657f192207" } new_table_name: "default.Table_9d5ad560ef6b47d1b30f5b78b7638733" modify_external_catalogs: true
I20260621 02:42:04.584246 2056 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_faabbcd5060949a29d7f5c57526fb922" } new_table_name: "default.Table_5a92341192d44cc889170dcf2bdf23dc" modify_external_catalogs: true
I20260621 02:42:04.583348 2057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:04.584918 2058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:04.583089 2059 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:04.585481 2058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:04.585561 2059 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:04.585233 2057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:04.583864 2055 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_7316d10767b943a3972b1a92374e24c9" } new_table_name: "default.Table_99d895f423774b16bccf9a8c0a5671fe" modify_external_catalogs: true
I20260621 02:42:04.582679 2061 master_service.cc:946] ReplaceTablet: received request to replace tablet 260404e813714081b78847d874de6c38 from {username='slave'} at 127.0.0.1:44554
I20260621 02:42:04.583938 2054 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_4e260ee413ad41378c547ad6650740fd" } new_table_name: "default.Table_5a02f30d3adf4196b07934e402f06d8e" modify_external_catalogs: true
I20260621 02:42:04.585490 2053 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_65a5205e941c44c5bdc59e0846793cb3" } new_table_name: "default.Table_d0753d0b484d47f691d51bf949845520" modify_external_catalogs: true
I20260621 02:42:04.591601 1863 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Refusing update from remote peer 5d142d25b86d4ad7935e806b7ebe8599: Log matching property violated. Preceding OpId in replica: term: 3 index: 111. Preceding OpId from leader: term: 4 index: 113. (index mismatch)
I20260621 02:42:04.592581 2126 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
W20260621 02:42:04.593015 2048 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 -> Peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Couldn't send request to peer 09161df32dff4fa18f1926765ea191d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:42:04.594699 2113 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:04.595165 2113 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:04.596403 2113 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:04.596673 2113 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:04.596768 2113 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
I20260621 02:42:04.597458 2130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d142d25b86d4ad7935e806b7ebe8599. Latest consensus state: current_term: 4 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:04.597785 2130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f902c9199ad google::LogMessage::Fail() at ??:0
I20260621 02:42:04.599944 2129 mvcc.cc:205] Tried to move back new op lower bound from 7299111831919063040 to 7299111831672799232. Current Snapshot: MvccSnapshot[applied={T|T < 7299111831919063040}]
I20260621 02:42:04.600324 2131 mvcc.cc:205] Tried to move back new op lower bound from 7299111831919063040 to 7299111831672799232. Current Snapshot: MvccSnapshot[applied={T|T < 7299111831919063040}]
@ 0x7f902c91c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f902c9194de google::LogMessage::Flush() at ??:0
@ 0x7f902c9196d1 google::LogMessage::~LogMessage() at ??:0
I20260621 02:42:04.605923 2061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet 260404e813714081b78847d874de6c38
I20260621 02:42:04.611413 2061 catalog_manager.cc:6565] ReplaceTablet: tablet 260404e813714081b78847d874de6c38 deleted and replaced by tablet 726112934f3b493f963e037a33f184c1
I20260621 02:42:04.618927 2060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet fb30ab4457aa45858a6e722be50eb43b
I20260621 02:42:04.619621 2060 catalog_manager.cc:6565] ReplaceTablet: tablet fb30ab4457aa45858a6e722be50eb43b deleted and replaced by tablet aaba3cc349d94544a7959d15d4cead98
I20260621 02:42:04.619993 2060 master_service.cc:946] ReplaceTablet: received request to replace tablet c8e6eed9c51943bb81997aa8c4d880eb from {username='slave'} at 127.0.0.1:44554
I20260621 02:42:04.623659 1237 tablet_service.cc:1514] Processing DeleteTablet for tablet 260404e813714081b78847d874de6c38 with delete_type TABLET_DATA_DELETED (replaced by tablet 726112934f3b493f963e037a33f184c1) from {username='slave'} at 127.0.0.1:43884
I20260621 02:42:04.623811 1238 tablet_service.cc:1514] Processing DeleteTablet for tablet fb30ab4457aa45858a6e722be50eb43b with delete_type TABLET_DATA_DELETED (replaced by tablet aaba3cc349d94544a7959d15d4cead98) from {username='slave'} at 127.0.0.1:43884
I20260621 02:42:04.624224 2130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:04.624485 2130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f90424b7ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f90424b6901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260621 02:42:04.634915 2061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:04.635321 2061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:04.635792 2126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "5d142d25b86d4ad7935e806b7ebe8599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:04.636130 2126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:04.636541 1104 tablet_service.cc:1514] Processing DeleteTablet for tablet 260404e813714081b78847d874de6c38 with delete_type TABLET_DATA_DELETED (replaced by tablet 726112934f3b493f963e037a33f184c1) from {username='slave'} at 127.0.0.1:35006
I20260621 02:42:04.637053 2060 master_service.cc:946] ReplaceTablet: received request to replace tablet a50603036c5046e8aba135c3787f890a from {username='slave'} at 127.0.0.1:44554
@ 0x7f90424bd66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260621 02:42:04.640452 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet fb30ab4457aa45858a6e722be50eb43b with delete_type TABLET_DATA_DELETED (replaced by tablet aaba3cc349d94544a7959d15d4cead98) from {username='slave'} at 127.0.0.1:35006
@ 0x7f90424bd4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260621 02:42:04.648653 2060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Sending DeleteTablet for 3 replicas of tablet a50603036c5046e8aba135c3787f890a
I20260621 02:42:04.649202 2060 catalog_manager.cc:6565] ReplaceTablet: tablet a50603036c5046e8aba135c3787f890a deleted and replaced by tablet b3f34722963e45c0bebf87be46da8efd
I20260621 02:42:04.649479 2060 master_service.cc:946] ReplaceTablet: received request to replace tablet fb30ab4457aa45858a6e722be50eb43b from {username='slave'} at 127.0.0.1:44554
I20260621 02:42:04.649752 1109 tablet_service.cc:1514] Processing DeleteTablet for tablet a50603036c5046e8aba135c3787f890a with delete_type TABLET_DATA_DELETED (replaced by tablet b3f34722963e45c0bebf87be46da8efd) from {username='slave'} at 127.0.0.1:35006
I20260621 02:42:04.649822 964 tablet_service.cc:1514] Processing DeleteTablet for tablet 260404e813714081b78847d874de6c38 with delete_type TABLET_DATA_DELETED (replaced by tablet 726112934f3b493f963e037a33f184c1) from {username='slave'} at 127.0.0.1:38364
@ 0x7f902f543eaf kudu::Thread::SuperviseThread() at ??:0
I20260621 02:42:04.650074 2060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:04.650233 969 tablet_service.cc:1514] Processing DeleteTablet for tablet fb30ab4457aa45858a6e722be50eb43b with delete_type TABLET_DATA_DELETED (replaced by tablet aaba3cc349d94544a7959d15d4cead98) from {username='slave'} at 127.0.0.1:38364
I20260621 02:42:04.650337 2060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44554:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:04.651175 969 tablet_service.cc:1514] Processing DeleteTablet for tablet a50603036c5046e8aba135c3787f890a with delete_type TABLET_DATA_DELETED (replaced by tablet b3f34722963e45c0bebf87be46da8efd) from {username='slave'} at 127.0.0.1:38364
I20260621 02:42:04.651706 2143 tablet_replica.cc:330] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:42:04.652007 2143 raft_consensus.cc:2229] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.651649 1238 tablet_service.cc:1514] Processing DeleteTablet for tablet a50603036c5046e8aba135c3787f890a with delete_type TABLET_DATA_DELETED (replaced by tablet b3f34722963e45c0bebf87be46da8efd) from {username='slave'} at 127.0.0.1:43884
I20260621 02:42:04.652278 2143 raft_consensus.cc:2258] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.653075 2143 ts_tablet_manager.cc:1905] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f903281d6db start_thread at ??:0
@ 0x7f902b7b361f clone at ??:0
I20260621 02:42:04.657063 2146 tablet_replica.cc:330] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:42:04.657249 2145 tablet_replica.cc:330] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:42:04.657299 2146 raft_consensus.cc:2229] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.657495 2145 raft_consensus.cc:2229] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:42:04.657709 2146 raft_consensus.cc:2258] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.657881 2145 raft_consensus.cc:2258] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.658340 2146 ts_tablet_manager.cc:1905] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.658470 2145 ts_tablet_manager.cc:1905] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.660555 2143 ts_tablet_manager.cc:1918] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:04.660684 2143 log.cc:1196] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/260404e813714081b78847d874de6c38
I20260621 02:42:04.661119 2143 ts_tablet_manager.cc:1939] T 260404e813714081b78847d874de6c38 P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:42:04.662276 2143 tablet_replica.cc:330] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:42:04.662493 2143 raft_consensus.cc:2229] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:42:04.662786 2143 raft_consensus.cc:2258] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.663365 2143 ts_tablet_manager.cc:1905] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.664882 2146 ts_tablet_manager.cc:1918] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:04.665022 2146 log.cc:1196] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/260404e813714081b78847d874de6c38
I20260621 02:42:04.665094 2145 ts_tablet_manager.cc:1918] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260621 02:42:04.665220 2145 log.cc:1196] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/260404e813714081b78847d874de6c38
I20260621 02:42:04.665674 2145 ts_tablet_manager.cc:1939] T 260404e813714081b78847d874de6c38 P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:42:04.665741 2146 ts_tablet_manager.cc:1939] T 260404e813714081b78847d874de6c38 P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:42:04.666860 2146 tablet_replica.cc:330] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:42:04.666968 2145 tablet_replica.cc:330] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:42:04.667084 2146 raft_consensus.cc:2229] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.667182 2145 raft_consensus.cc:2229] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.667263 2146 raft_consensus.cc:2258] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.667342 2145 raft_consensus.cc:2258] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.667894 2146 ts_tablet_manager.cc:1905] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.667941 2145 ts_tablet_manager.cc:1905] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.669783 2143 ts_tablet_manager.cc:1918] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.669924 2143 log.cc:1196] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/fb30ab4457aa45858a6e722be50eb43b
I20260621 02:42:04.670323 2143 ts_tablet_manager.cc:1939] T fb30ab4457aa45858a6e722be50eb43b P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:42:04.671672 2143 tablet_replica.cc:330] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: stopping tablet replica
I20260621 02:42:04.671886 2143 raft_consensus.cc:2229] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.672089 2143 raft_consensus.cc:2258] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.672618 2143 ts_tablet_manager.cc:1905] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.674636 2146 ts_tablet_manager.cc:1918] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.674788 2146 log.cc:1196] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/fb30ab4457aa45858a6e722be50eb43b
I20260621 02:42:04.675225 2146 ts_tablet_manager.cc:1939] T fb30ab4457aa45858a6e722be50eb43b P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:42:04.676251 2146 tablet_replica.cc:330] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: stopping tablet replica
I20260621 02:42:04.676447 2146 raft_consensus.cc:2229] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 1 LEADER]: Raft consensus shutting down.
I20260621 02:42:04.676928 2146 raft_consensus.cc:2258] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.677577 2146 ts_tablet_manager.cc:1905] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.679152 2143 ts_tablet_manager.cc:1918] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.679291 2143 log.cc:1196] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-2/wal/wals/a50603036c5046e8aba135c3787f890a
I20260621 02:42:04.679726 2143 ts_tablet_manager.cc:1939] T a50603036c5046e8aba135c3787f890a P a2d4d8ec6f9845f5bbfca1390740aedc: Deleting consensus metadata
I20260621 02:42:04.680647 2145 ts_tablet_manager.cc:1918] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.680799 2145 log.cc:1196] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/fb30ab4457aa45858a6e722be50eb43b
I20260621 02:42:04.681218 2145 ts_tablet_manager.cc:1939] T fb30ab4457aa45858a6e722be50eb43b P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
I20260621 02:42:04.682149 2145 tablet_replica.cc:330] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: stopping tablet replica
I20260621 02:42:04.682391 2145 raft_consensus.cc:2229] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 02:42:04.682613 2145 raft_consensus.cc:2258] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 02:42:04.683233 2145 ts_tablet_manager.cc:1905] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260621 02:42:04.684146 2146 ts_tablet_manager.cc:1918] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.684271 2146 log.cc:1196] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-0/wal/wals/a50603036c5046e8aba135c3787f890a
I20260621 02:42:04.684684 2146 ts_tablet_manager.cc:1939] T a50603036c5046e8aba135c3787f890a P 35b23c9f06314e4abf6d8aff8989e73e: Deleting consensus metadata
I20260621 02:42:04.689437 2145 ts_tablet_manager.cc:1918] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260621 02:42:04.689601 2145 log.cc:1196] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Deleting WAL directory at /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/ts-1/wal/wals/a50603036c5046e8aba135c3787f890a
I20260621 02:42:04.690003 2145 ts_tablet_manager.cc:1939] T a50603036c5046e8aba135c3787f890a P 6f52030a7bb641f883dba1ffbd912dba: Deleting consensus metadata
W20260621 02:42:04.859115 1062 connection.cc:535] server connection from 127.0.0.1:35006 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.859200 1198 connection.cc:535] server connection from 127.0.0.1:43884 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.859206 925 connection.cc:535] server connection from 127.0.0.1:38364 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.859261 924 connection.cc:535] client connection to 127.0.97.60:39755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.859393 1062 connection.cc:535] client connection to 127.0.97.60:39755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.860080 1315 connection.cc:535] client connection to 127.0.97.60:39755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:04.860752 1315 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.60:39755)
W20260621 02:42:04.861621 1315 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.60:39755)
W20260621 02:42:04.862546 1315 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.60:39755)
W20260621 02:42:04.862685 1315 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.60:39755)
I20260621 02:42:05.146996 2156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:05.147246 2156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:05.147943 2156 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:05.150096 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:05.150298 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:05.150414 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:05.150629 2156 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260621 02:42:05.299563 1765 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:05.299777 1765 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:05.796430 2162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:05.796664 2162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:05.797379 2162 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:05.799408 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:05.799621 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:05.799764 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:05.800024 2162 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260621 02:42:06.766736 2167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:06.766924 2167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:06.767560 2167 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:06.769949 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:06.770323 1836 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:06.770486 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:06.770797 2167 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260621 02:42:06.835870 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--webserver_interface=127.0.97.62
--webserver_port=37371
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:42:07.190768 2171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:07.191154 2171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:07.191305 2171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:07.199059 2171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:07.199220 2171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:07.199323 2171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:07.199434 2171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:07.210075 2171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=37371
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:07.211861 2171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:07.213945 2171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:07.227646 2177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:07.227653 2176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:07.228384 2179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:07.229199 2171 server_base.cc:1034] running on GCE node
I20260621 02:42:07.230350 2171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:07.232012 2171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:07.233280 2171 hybrid_clock.cc:648] HybridClock initialized: now 1782009727233101 us; error 145 us; skew 500 ppm
I20260621 02:42:07.233794 2171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:07.240907 2171 webserver.cc:460] Webserver started at http://127.0.97.62:37371/ using document root <none> and password file <none>
I20260621 02:42:07.241784 2171 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:07.241950 2171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:07.247881 2171 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260621 02:42:07.251652 2185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:07.253692 2171 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260621 02:42:07.253939 2171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:42:07.255038 2171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:07.288990 2171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:07.290066 2171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:07.290402 2171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:07.312060 2171 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:44219
I20260621 02:42:07.312078 2236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:44219 every 8 connection(s)
I20260621 02:42:07.313745 2171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
I20260621 02:42:07.316571 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2171
I20260621 02:42:07.321579 2237 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:07.326073 2237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap starting.
I20260621 02:42:07.345686 2237 log.cc:824] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:07.352335 1175 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:42:07.404175 1309 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:42:07.433789 2237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=105 overwritten=0 applied=105 ignored=0} inserts{seen=71 ignored=0} mutations{seen=88 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 02:42:07.434424 2237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap complete.
I20260621 02:42:07.443092 2237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:07.444038 2237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Initialized, Role: FOLLOWER
I20260621 02:42:07.444717 2237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 105, Last appended: 2.105, Last appended by leader: 105, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:07.445614 2241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.445978 2241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:07.446790 2237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:07.469467 2256 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:07.469630 2256 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: loading cluster ID for follower catalog manager: success
I20260621 02:42:07.476402 2256 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: acquiring CA information for follower catalog manager: success
I20260621 02:42:07.480180 2256 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:07.486881 2171 master_runner.cc:186] Error getting master registration for 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111),
I20260621 02:42:07.493525 2171 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:07.568914 2261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:07.569154 2261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:07.570122 2261 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:07.571442 1833 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260621 02:42:07.573441 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:07.578667 2212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 5 candidate_status { last_received { term: 4 index: 115 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:42:07.579309 2212 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 2.
I20260621 02:42:07.580082 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters: 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:07.580438 2261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260621 02:42:07.580566 2261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d142d25b86d4ad7935e806b7ebe8599)
I20260621 02:42:07.580683 2261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 4 FOLLOWER]: Advancing to term 5
I20260621 02:42:07.582808 2261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:07.583518 2261 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:07.583981 2212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 5 candidate_status { last_received { term: 4 index: 115 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9"
I20260621 02:42:07.584209 2212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 2 FOLLOWER]: Advancing to term 5
W20260621 02:42:07.585222 1833 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:07.588727 2212 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 5.
I20260621 02:42:07.589288 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters: 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:07.589692 2261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Leader election won for term 5
I20260621 02:42:07.590170 2261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 LEADER]: Becoming Leader. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Running, Role: LEADER
I20260621 02:42:07.590679 2261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 4.115, Last appended by leader: 115, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:07.592943 2265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3391f089f71e447b9628bac16fe3443c. Latest consensus state: current_term: 5 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.593618 2265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:07.594389 2267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:07.597472 2267 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:07.597975 2267 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:07.598315 2267 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:07.598668 2267 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:07.599006 2267 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:07.599339 2267 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:07.599649 2267 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:07.599987 2267 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:07.600522 2267 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:07.601303 2267 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:07.601730 2267 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:07.602272 2267 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:07.602680 2267 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:07.603008 2267 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:07.603327 2267 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:07.606005 2267 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:07.606379 2267 tablet_loader.cc:96] loaded metadata for tablet 1c4d7a76b39841988629f0db75f1f69e (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:07.606706 2267 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:07.607636 2267 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:07.607924 2267 tablet_loader.cc:96] loaded metadata for tablet 5e49f47887e044668800410f7a7b72b4 (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:07.608201 2267 tablet_loader.cc:96] loaded metadata for tablet 67321be37d724469b620707de07c7f03 (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:07.608780 2267 tablet_loader.cc:96] loaded metadata for tablet 726112934f3b493f963e037a33f184c1 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:07.609340 2267 tablet_loader.cc:96] loaded metadata for tablet 7d2fc2340c3d4e0d860c91205eaedf68 (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:07.609720 2267 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:07.610149 2267 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:07.610783 2267 tablet_loader.cc:96] loaded metadata for tablet aaba3cc349d94544a7959d15d4cead98 (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:07.611171 2267 tablet_loader.cc:96] loaded metadata for tablet b3f34722963e45c0bebf87be46da8efd (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:07.611451 2267 tablet_loader.cc:96] loaded metadata for tablet c09f475cc8fc487aba84bdba81d6ea97 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:07.611996 2267 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:07.612414 2267 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:07.613113 2267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:07.614662 2267 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:07.614743 2267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:07.616474 2267 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:07.617951 2267 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Loaded TSK: 0
I20260621 02:42:07.618889 2267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:07.620218 2267 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:07.621747 2267 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:07.672899 1852 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c4d7a76b39841988629f0db75f1f69e from {username='slave'} at 127.0.0.1:45384
I20260621 02:42:07.674540 1844 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45384:
name: "default.Table_5ca503a3c4ba46a6bda089bf52d0f837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:07.675678 1846 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45384:
name: "default.Table_3548a6e62b27484d8fa771f8688ca8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:07.677592 1850 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d2fc2340c3d4e0d860c91205eaedf68 from {username='slave'} at 127.0.0.1:45384
I20260621 02:42:07.678175 1853 master_service.cc:946] ReplaceTablet: received request to replace tablet 67321be37d724469b620707de07c7f03 from {username='slave'} at 127.0.0.1:45384
I20260621 02:42:07.677292 1848 master_service.cc:946] ReplaceTablet: received request to replace tablet c09f475cc8fc487aba84bdba81d6ea97 from {username='slave'} at 127.0.0.1:45384
I20260621 02:42:07.678762 1851 master_service.cc:946] ReplaceTablet: received request to replace tablet 5e49f47887e044668800410f7a7b72b4 from {username='slave'} at 127.0.0.1:45384
I20260621 02:42:07.679147 1842 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45384:
name: "default.Table_6217ff360f914564a1fee8cacc9c1e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:07.683476 1847 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45384:
name: "default.Table_608c53f32c054ee49c55bcf8ee3a7e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:07.689059 1841 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45384:
name: "default.Table_f380223331ea479893e63d4d53570bed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260621 02:42:07.692173 1833 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c -> Peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Couldn't send request to peer 5d142d25b86d4ad7935e806b7ebe8599. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:42:07.695223 2212 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Refusing update from remote peer 3391f089f71e447b9628bac16fe3443c: Log matching property violated. Preceding OpId in replica: term: 2 index: 105. Preceding OpId from leader: term: 5 index: 118. (index mismatch)
I20260621 02:42:07.696158 2261 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [LEADER]: Connected to new peer: Peer: permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 105, Time since last communication: 0.000s
I20260621 02:42:07.697016 1910 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:07.698782 1910 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:07.702452 1910 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:07.702762 1910 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:07.702848 1910 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
@ 0x7f6474a009ad google::LogMessage::Fail() at ??:0
@ 0x7f6474a0388a google::LogMessage::SendToLog() at ??:0
@ 0x7f6474a004de google::LogMessage::Flush() at ??:0
@ 0x7f6474a006d1 google::LogMessage::~LogMessage() at ??:0
I20260621 02:42:07.714437 2270 mvcc.cc:205] Tried to move back new op lower bound from 7299111818747240448 to 7299111815907704832. Current Snapshot: MvccSnapshot[applied={T|T < 7299111818747240448}]
@ 0x7f648a59eba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f648a59d901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260621 02:42:07.729446 1037 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
@ 0x7f648a5a466c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f648a5a44e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260621 02:42:07.739383 2241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3391f089f71e447b9628bac16fe3443c. Latest consensus state: current_term: 5 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.741961 2241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:07.739600 2278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.742640 2278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:07.738893 2273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.743219 2273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f647762aeaf kudu::Thread::SuperviseThread() at ??:0
I20260621 02:42:07.746155 2202 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:42905; Asking this server to re-register.
I20260621 02:42:07.747375 1037 heartbeater.cc:464] Registering TS with master...
@ 0x7f647a9046db start_thread at ??:0
I20260621 02:42:07.751281 1852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Sending DeleteTablet for 3 replicas of tablet 1c4d7a76b39841988629f0db75f1f69e
I20260621 02:42:07.751374 1853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Sending DeleteTablet for 3 replicas of tablet 67321be37d724469b620707de07c7f03
@ 0x7f647389a61f clone at ??:0
I20260621 02:42:07.757614 2273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:07.757890 2273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:07.758965 2202 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:07.858261 2202 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:48873; Asking this server to re-register.
I20260621 02:42:07.859181 1175 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:07.861199 2202 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:07.910411 2202 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:36491; Asking this server to re-register.
I20260621 02:42:07.911259 1309 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:07.913141 2202 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
W20260621 02:42:07.988595 2287 negotiation.cc:337] Failed RPC negotiation. Trace:
0621 02:42:07.754625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55530 (local address 127.0.97.2:42873)
0621 02:42:07.757794 (+ 3169us) server_negotiation.cc:206] Beginning negotiation
0621 02:42:07.757800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0621 02:42:07.757822 (+ 22us) server_negotiation.cc:407] Connection header received
0621 02:42:07.988322 (+230500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55530: BlockingRecv error: recv got EOF from 127.0.0.1:55530 (error 108)
Metrics: {"server-negotiator.queue_time_us":3037,"thread_start_us":4467,"threads_started":1}
W20260621 02:42:07.988669 2285 negotiation.cc:337] Failed RPC negotiation. Trace:
0621 02:42:07.753489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.0.97.3:36259)
0621 02:42:07.758445 (+ 4956us) server_negotiation.cc:206] Beginning negotiation
0621 02:42:07.758451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0621 02:42:07.758474 (+ 23us) server_negotiation.cc:407] Connection header received
0621 02:42:07.758558 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0621 02:42:07.758566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0621 02:42:07.758727 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0621 02:42:07.758835 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0621 02:42:07.988348 (+229513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42972: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":4821,"thread_start_us":4692,"threads_started":1}
W20260621 02:42:07.988698 2188 connection.cc:535] server connection from 127.0.0.1:47128 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:07.989342 2288 negotiation.cc:337] Failed RPC negotiation. Trace:
0621 02:42:07.755076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56384 (local address 127.0.97.1:46793)
0621 02:42:07.755633 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0621 02:42:07.755640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0621 02:42:07.988338 (+232698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56384: BlockingRecv error: recv got EOF from 127.0.0.1:56384 (error 108)
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":264,"threads_started":1}
W20260621 02:42:07.989720 1318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:07.989704 1199 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:07.990015 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:07.990343 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:07.990773 1065 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:07.991231 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.61:35493)
I20260621 02:42:08.243769 2273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:08.244020 2273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:08.245710 2273 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:08.246954 2186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:08.248494 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:08.248788 2189 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:08.248973 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9; no voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:08.249388 2273 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260621 02:42:08.997996 2304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:08.998214 2304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:08.998925 2304 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:09.001212 2189 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:42:09.001432 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:09.001569 2186 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9; no voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:09.002007 2304 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260621 02:42:09.701098 2309 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:09.701335 2309 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:09.702116 2309 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:09.704345 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:09.704537 2189 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:09.704721 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9; no voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:09.704984 2309 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260621 02:42:10.473803 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--webserver_interface=127.0.97.61
--webserver_port=41917
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260621 02:42:10.668790 2314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:10.669006 2314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:10.669785 2314 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:10.672298 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
W20260621 02:42:10.672518 2189 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:10.672724 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9; no voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:10.673032 2314 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260621 02:42:10.827251 2313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:10.827554 2313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:10.827716 2313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:10.835845 2313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:10.835963 2313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:10.836051 2313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:10.836160 2313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:10.847195 2313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=41917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:10.848733 2313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:10.850708 2313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:10.865137 2325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:10.865257 2323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:10.865226 2322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:10.866300 2313 server_base.cc:1034] running on GCE node
I20260621 02:42:10.867192 2313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:10.868736 2313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:10.870014 2313 hybrid_clock.cc:648] HybridClock initialized: now 1782009730869937 us; error 51 us; skew 500 ppm
I20260621 02:42:10.870414 2313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:10.873039 2313 webserver.cc:460] Webserver started at http://127.0.97.61:41917/ using document root <none> and password file <none>
I20260621 02:42:10.874212 2313 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:10.874468 2313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:10.881897 2313 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260621 02:42:10.885707 2331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:10.887768 2313 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260621 02:42:10.888000 2313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:10.889465 2313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:10.913781 2313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:10.914746 2313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:10.915107 2313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:10.939298 2313 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:35493
I20260621 02:42:10.939250 2382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:35493 every 8 connection(s)
I20260621 02:42:10.941768 2313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
I20260621 02:42:10.944854 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2313
I20260621 02:42:10.950647 2383 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:10.954511 2383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap starting.
I20260621 02:42:10.973987 2383 log.cc:824] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:11.007146 1038 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:11.008548 1176 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:11.009429 1310 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:11.064831 2383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap replayed 1/1 log segments. Stats: ops{read=121 overwritten=0 applied=117 ignored=0} inserts{seen=78 ignored=0} mutations{seen=97 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260621 02:42:11.065478 2383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap complete.
I20260621 02:42:11.073009 2383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:11.076638 2383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Initialized, Role: FOLLOWER
I20260621 02:42:11.077421 2383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 117, Last appended: 5.121, Last appended by leader: 121, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:11.078183 2390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:11.078512 2390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:11.079493 2383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:11.115497 2404 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:11.115623 2404 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: loading cluster ID for follower catalog manager: success
I20260621 02:42:11.121562 2404 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: acquiring CA information for follower catalog manager: success
I20260621 02:42:11.126570 2404 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:11.126693 2313 master_runner.cc:186] Error getting master registration for 127.0.97.60:39755: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111),
I20260621 02:42:11.132890 2313 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:11.413062 2409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:11.413309 2409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:11.414094 2409 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:11.416905 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:11.423030 2358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 6 candidate_status { last_received { term: 5 index: 121 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c" is_pre_election: true
I20260621 02:42:11.423799 2358 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 5.
I20260621 02:42:11.424475 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters: 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:11.424810 2409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260621 02:42:11.424978 2409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3391f089f71e447b9628bac16fe3443c)
I20260621 02:42:11.425077 2409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 5 FOLLOWER]: Advancing to term 6
I20260621 02:42:11.427177 2409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:11.427866 2409 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 election: Requested vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:11.428474 2358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 6 candidate_status { last_received { term: 5 index: 121 } } ignore_live_leader: false dest_uuid: "3391f089f71e447b9628bac16fe3443c"
I20260621 02:42:11.428738 2358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 5 FOLLOWER]: Advancing to term 6
W20260621 02:42:11.430279 2186 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:11.433954 2358 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 6.
I20260621 02:42:11.434454 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c; no voters: 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:11.434795 2409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Leader election won for term 6
I20260621 02:42:11.435323 2409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 LEADER]: Becoming Leader. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Running, Role: LEADER
I20260621 02:42:11.435801 2409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 5.121, Last appended by leader: 121, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:11.437732 2413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 6 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:11.438331 2413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:11.513618 2346 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:38275; Asking this server to re-register.
I20260621 02:42:11.513715 2347 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:35805; Asking this server to re-register.
I20260621 02:42:11.513743 2348 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:47355; Asking this server to re-register.
I20260621 02:42:11.514501 1310 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:11.514540 1038 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:11.514602 1176 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:11.516607 2347 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:11.516685 2348 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:11.516795 2346 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
W20260621 02:42:12.016748 2186 consensus_peers.cc:487] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 -> Peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Couldn't send request to peer 5d142d25b86d4ad7935e806b7ebe8599. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:42:12.042101 2358 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Refusing update from remote peer 09161df32dff4fa18f1926765ea191d9: Log matching property violated. Preceding OpId in replica: term: 5 index: 121. Preceding OpId from leader: term: 6 index: 122. (index mismatch)
I20260621 02:42:12.042933 2419 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 117, Time since last communication: 0.000s
I20260621 02:42:12.046418 2422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:12.046684 2422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:12.048471 2423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 6 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:12.048838 2423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:12.050063 2422 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:12.050184 2211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 7 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
W20260621 02:42:12.052294 2332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:12.053516 2422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:12.053776 2422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
W20260621 02:42:12.054307 2332 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:12.054592 2332 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:12.055395 2422 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260621 02:42:12.057180 2426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:12.057473 2426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:12.085031 2415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:12.088275 2415 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:12.088743 2415 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:12.089102 2415 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:12.089511 2415 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:12.089859 2415 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:12.090202 2415 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:12.090510 2415 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:12.090833 2415 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:12.091279 2415 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:12.091859 2415 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:12.092183 2415 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:12.092630 2415 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:12.092947 2415 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:12.093267 2415 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:12.093623 2415 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:12.096544 2415 tablet_loader.cc:96] loaded metadata for tablet 1543eb0831ae452db2d85aa8e8659c4f (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:12.096863 2415 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:12.097289 2415 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:12.097954 2415 tablet_loader.cc:96] loaded metadata for tablet 3126b97849d0422e95211d2419e6abf3 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:12.098515 2415 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:12.099261 2415 tablet_loader.cc:96] loaded metadata for tablet 726112934f3b493f963e037a33f184c1 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:12.099856 2415 tablet_loader.cc:96] loaded metadata for tablet 86b1a4fe9c374ba1adb16b4c99811200 (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:12.100138 2415 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:12.100557 2415 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:12.101178 2415 tablet_loader.cc:96] loaded metadata for tablet aa8d4109be4d43b994ab3a2154a90ded (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:12.101513 2415 tablet_loader.cc:96] loaded metadata for tablet aaba3cc349d94544a7959d15d4cead98 (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:12.101898 2415 tablet_loader.cc:96] loaded metadata for tablet b3f34722963e45c0bebf87be46da8efd (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:12.102622 2415 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:12.102859 2415 tablet_loader.cc:96] loaded metadata for tablet d493adcd9e724684a0064d789ba565cc (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:12.103268 2415 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:12.103971 2415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:12.105780 2415 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:12.105866 2415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:12.107724 2415 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:12.109253 2415 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Loaded TSK: 0
I20260621 02:42:12.110278 2415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:12.111790 2415 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:12.113320 2415 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:12.176438 2202 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:12.176555 2201 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43900:
name: "default.Table_66ba19cef5dc4906ad2b7f2946cac9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:12.176780 2202 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:12.177129 2197 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_4e260ee413ad41378c547ad6650740fd" } new_table_name: "default.Table_5a02f30d3adf4196b07934e402f06d8e" modify_external_catalogs: true
I20260621 02:42:12.179438 2199 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_55949c61dce74206ba47a1657f192207" } new_table_name: "default.Table_9d5ad560ef6b47d1b30f5b78b7638733" modify_external_catalogs: true
I20260621 02:42:12.179464 2198 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_65a5205e941c44c5bdc59e0846793cb3" } new_table_name: "default.Table_d0753d0b484d47f691d51bf949845520" modify_external_catalogs: true
I20260621 02:42:12.177608 2200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:12.180585 2195 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:12.180814 2196 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_7316d10767b943a3972b1a92374e24c9" } new_table_name: "default.Table_99d895f423774b16bccf9a8c0a5671fe" modify_external_catalogs: true
I20260621 02:42:12.181313 2200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:12.181443 2195 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:12.180373 2194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:12.181701 2194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43900:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:12.177964 2193 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43900:
name: "default.Table_608c53f32c054ee49c55bcf8ee3a7e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:12.190361 2254 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:12.190872 2254 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:12.191735 2254 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:12.191992 2254 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:12.192058 2254 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
@ 0x7f253927c9ad google::LogMessage::Fail() at ??:0
@ 0x7f253927f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f253927c4de google::LogMessage::Flush() at ??:0
@ 0x7f253927c6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f254ee1aba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f254ee19901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f254ee2066c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f254ee204e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f253bea6eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f253f1806db start_thread at ??:0
@ 0x7f253811661f clone at ??:0
W20260621 02:42:12.389150 927 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:12.390188 1065 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:12.390908 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:44219)
W20260621 02:42:12.391202 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:44219)
W20260621 02:42:12.391443 1318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:44219)
W20260621 02:42:12.392664 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:44219)
I20260621 02:42:12.673991 2450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:12.674242 2450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:12.674924 2450 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:12.679512 2335 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:12.679699 2332 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:12.679890 2332 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:12.680267 2450 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260621 02:42:13.523187 2457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:13.523540 2457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:13.524343 2457 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:13.529588 2335 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:13.530007 2332 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755): Network error: Client connection negotiation failed: client connection to 127.0.97.60:39755: connect: Connection refused (error 111)
I20260621 02:42:13.530215 2332 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c; no voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599
I20260621 02:42:13.530514 2457 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260621 02:42:14.078307 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--webserver_interface=127.0.97.60
--webserver_port=39369
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:42:14.425927 2461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:14.426229 2461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:14.426363 2461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:14.433825 2461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:14.433993 2461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:14.434064 2461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:14.434170 2461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:14.444854 2461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=39369
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:14.446306 2461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:14.448038 2461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:14.459645 2469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:14.460366 2466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:14.460366 2467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:14.461308 2461 server_base.cc:1034] running on GCE node
I20260621 02:42:14.462145 2461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:14.463717 2461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:14.464994 2461 hybrid_clock.cc:648] HybridClock initialized: now 1782009734464919 us; error 42 us; skew 500 ppm
I20260621 02:42:14.465420 2461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:14.471190 2461 webserver.cc:460] Webserver started at http://127.0.97.60:39369/ using document root <none> and password file <none>
I20260621 02:42:14.471956 2461 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:14.472108 2461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:14.477712 2461 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260621 02:42:14.480981 2475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:14.482602 2461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260621 02:42:14.482757 2461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:14.483747 2461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:14.501017 2461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:14.502012 2461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:14.502355 2461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:14.521489 2461 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:39755
I20260621 02:42:14.521538 2526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:39755 every 8 connection(s)
I20260621 02:42:14.523139 2461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
I20260621 02:42:14.527669 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2461
I20260621 02:42:14.531001 2527 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:14.536448 2527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap starting.
I20260621 02:42:14.558738 2527 log.cc:824] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:14.648104 2527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap replayed 1/1 log segments. Stats: ops{read=116 overwritten=0 applied=115 ignored=0} inserts{seen=77 ignored=0} mutations{seen=96 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260621 02:42:14.648739 2527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap complete.
I20260621 02:42:14.657678 2527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:14.661594 2527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Initialized, Role: FOLLOWER
I20260621 02:42:14.662519 2527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 115, Last appended: 4.116, Last appended by leader: 116, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:14.663720 2532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:14.664280 2532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:14.664960 2527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:14.680756 2546 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:14.680871 2546 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: loading cluster ID for follower catalog manager: success
I20260621 02:42:14.686357 2546 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: acquiring CA information for follower catalog manager: success
I20260621 02:42:14.690236 2546 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:14.694958 2550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:14.695295 2550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:14.690407 2461 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:14.702523 2461 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:14.704906 2550 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:14.708777 2335 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:14.713656 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 7 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:42:14.714294 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 4.
I20260621 02:42:14.714939 2332 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:14.715281 2550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260621 02:42:14.715422 2550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:14.715533 2550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 6 FOLLOWER]: Advancing to term 7
I20260621 02:42:14.718811 2550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:14.719663 2550 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:14.720309 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 7 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599"
I20260621 02:42:14.720722 2502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 4 FOLLOWER]: Advancing to term 7
W20260621 02:42:14.721843 2335 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:14.725917 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 7.
I20260621 02:42:14.726519 2332 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:14.726889 2550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Leader election won for term 7
I20260621 02:42:14.727408 2550 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 LEADER]: Becoming Leader. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Running, Role: LEADER
I20260621 02:42:14.727954 2550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 6.122, Last appended by leader: 122, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:14.730098 2554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3391f089f71e447b9628bac16fe3443c. Latest consensus state: current_term: 7 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:14.730508 2554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:14.731320 2556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:14.734615 2556 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:14.735105 2556 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:14.735523 2556 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:14.735914 2556 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:14.736258 2556 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:14.736601 2556 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:14.736917 2556 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:14.737249 2556 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:14.737737 2556 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:14.738322 2556 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:14.738641 2556 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:14.739140 2556 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:14.739486 2556 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:14.739830 2556 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:14.740202 2556 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:14.743099 2556 tablet_loader.cc:96] loaded metadata for tablet 1543eb0831ae452db2d85aa8e8659c4f (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:14.743440 2556 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:14.743880 2556 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:14.744524 2556 tablet_loader.cc:96] loaded metadata for tablet 3126b97849d0422e95211d2419e6abf3 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:14.745048 2556 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:14.746012 2556 tablet_loader.cc:96] loaded metadata for tablet 726112934f3b493f963e037a33f184c1 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:14.746690 2556 tablet_loader.cc:96] loaded metadata for tablet 86b1a4fe9c374ba1adb16b4c99811200 (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:14.746994 2556 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:14.747467 2556 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:14.748152 2556 tablet_loader.cc:96] loaded metadata for tablet aa8d4109be4d43b994ab3a2154a90ded (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:14.748404 2556 tablet_loader.cc:96] loaded metadata for tablet aaba3cc349d94544a7959d15d4cead98 (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:14.748773 2556 tablet_loader.cc:96] loaded metadata for tablet b3f34722963e45c0bebf87be46da8efd (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:14.749490 2556 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:14.749763 2556 tablet_loader.cc:96] loaded metadata for tablet d493adcd9e724684a0064d789ba565cc (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:14.750407 2556 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:14.751143 2556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:14.752837 2556 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:14.752913 2556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:14.755128 2556 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:14.757306 2556 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Loaded TSK: 0
I20260621 02:42:14.758749 2556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:14.760565 2556 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:14.762940 2556 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:14.768179 2347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45034:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:14.768302 2345 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45034:
table { table_name: "default.Table_faabbcd5060949a29d7f5c57526fb922" } new_table_name: "default.Table_5a92341192d44cc889170dcf2bdf23dc" modify_external_catalogs: true
I20260621 02:42:14.768517 2347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45034:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:14.769399 2344 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_8b85797f61204810a499ef6b970dca59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.769811 2342 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_f380223331ea479893e63d4d53570bed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.770231 2341 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_6217ff360f914564a1fee8cacc9c1e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.769348 2340 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_5ca503a3c4ba46a6bda089bf52d0f837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.769685 2339 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45034:
table { table_name: "default.Table_4e260ee413ad41378c547ad6650740fd" } new_table_name: "default.Table_5a02f30d3adf4196b07934e402f06d8e" modify_external_catalogs: true
I20260621 02:42:14.770884 2346 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_0edb9612fcce47c99862ea3c6c864569"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.771437 2348 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_24e7a08d72a94d58a56750b388a7273a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.772025 2343 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45034:
name: "default.Table_522feae8f40d42578d1c405f347589bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:14.776044 2403 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:14.776566 2403 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:14.777871 2403 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:14.778136 2403 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:14.778218 2403 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
@ 0x7f65835699ad google::LogMessage::Fail() at ??:0
@ 0x7f658356c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f65835694de google::LogMessage::Flush() at ??:0
@ 0x7f65835696d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f6599107ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f6599106901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f659910d66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f659910d4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6586193eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f658946d6db start_thread at ??:0
@ 0x7f658240361f clone at ??:0
I20260621 02:42:14.901476 1174 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:14.905742 2492 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:53457; Asking this server to re-register.
I20260621 02:42:14.909910 1174 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:14.912411 2492 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:14.918630 1036 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:14.920476 2492 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:34701; Asking this server to re-register.
I20260621 02:42:14.921264 1036 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:14.923162 2492 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:14.946681 1308 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:14.948493 2492 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:57179; Asking this server to re-register.
I20260621 02:42:14.949205 1308 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:14.951051 2492 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
W20260621 02:42:15.009284 1318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:15.009634 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.61:35493)
W20260621 02:42:15.010358 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:15.011175 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.61:35493)
I20260621 02:42:15.235615 2573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:15.235888 2573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:15.237665 2573 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:15.238912 2479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:15.240573 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:15.240800 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:15.240883 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:15.241185 2573 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260621 02:42:15.917200 2577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:15.917428 2577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:15.918131 2577 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:15.920711 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:15.920938 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:15.921067 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:15.921499 2577 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260621 02:42:16.580549 2581 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:16.580729 2581 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:16.581293 2581 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:16.583873 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:16.584138 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:16.584223 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:16.584564 2581 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260621 02:42:17.596992 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--webserver_interface=127.0.97.61
--webserver_port=41917
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:42:17.940320 2585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:17.940675 2585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:17.940814 2585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:17.948534 2585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:17.948683 2585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:17.948782 2585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:17.948881 2585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:17.958873 2585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.61:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.97.61
--webserver_port=41917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:17.960311 2585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:17.962177 2585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:17.973985 2590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:17.974001 2593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:17.975015 2591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:17.976212 2585 server_base.cc:1034] running on GCE node
I20260621 02:42:17.976995 2585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:17.978567 2585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:17.979811 2585 hybrid_clock.cc:648] HybridClock initialized: now 1782009737979732 us; error 98 us; skew 500 ppm
I20260621 02:42:17.980155 2585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:17.982520 2585 webserver.cc:460] Webserver started at http://127.0.97.61:41917/ using document root <none> and password file <none>
I20260621 02:42:17.983317 2585 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:17.983466 2585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:17.988798 2585 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260621 02:42:17.991829 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:17.993172 2585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260621 02:42:17.993439 2585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
uuid: "3391f089f71e447b9628bac16fe3443c"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:17.994429 2585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:18.014048 2585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:18.015000 2585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:18.015321 2585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:18.017733 2607 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:18.017935 2607 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.018577 2607 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:18.020828 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:18.021039 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:18.021173 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:18.021456 2607 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260621 02:42:18.037707 2585 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.61:35493
I20260621 02:42:18.037725 2654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.61:35493 every 8 connection(s)
I20260621 02:42:18.039162 2585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-1/data/info.pb
I20260621 02:42:18.046893 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2585
I20260621 02:42:18.048324 2655 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:18.056011 2655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap starting.
I20260621 02:42:18.073633 1310 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:18.073854 1038 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:18.073940 1176 heartbeater.cc:347] Connected to a master server at 127.0.97.61:35493
I20260621 02:42:18.086242 2655 log.cc:824] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:18.173310 2655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap replayed 1/1 log segments. Stats: ops{read=123 overwritten=0 applied=122 ignored=0} inserts{seen=82 ignored=0} mutations{seen=101 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260621 02:42:18.173880 2655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Bootstrap complete.
I20260621 02:42:18.181576 2655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.182602 2655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Initialized, Role: FOLLOWER
I20260621 02:42:18.183225 2655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 122, Last appended: 7.123, Last appended by leader: 123, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.183984 2662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:18.184341 2662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:18.185101 2655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:18.201254 2676 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:18.201534 2676 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: loading cluster ID for follower catalog manager: success
I20260621 02:42:18.196894 2585 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:18.207214 2585 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:18.207778 2676 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: acquiring CA information for follower catalog manager: success
I20260621 02:42:18.211987 2676 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:18.579721 2620 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:53517; Asking this server to re-register.
I20260621 02:42:18.579696 2618 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:49757; Asking this server to re-register.
I20260621 02:42:18.579675 2619 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:46663; Asking this server to re-register.
I20260621 02:42:18.580612 1176 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:18.580669 1310 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:18.580739 1038 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:18.582657 2619 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:18.582773 2620 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:18.582916 2618 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:18.741892 2680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:18.742201 2680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.743942 2680 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:18.745348 2604 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:18.747113 2604 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:18.752027 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 8 candidate_status { last_received { term: 7 index: 123 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:42:18.752329 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 7.
I20260621 02:42:18.753190 2601 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:18.753811 2680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260621 02:42:18.753990 2680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:18.754114 2680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 7 FOLLOWER]: Advancing to term 8
I20260621 02:42:18.758380 2680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.759176 2680 leader_election.cc:288] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 election: Requested vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:18.759805 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3391f089f71e447b9628bac16fe3443c" candidate_term: 8 candidate_status { last_received { term: 7 index: 123 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599"
I20260621 02:42:18.760056 2502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 7 FOLLOWER]: Advancing to term 8
W20260621 02:42:18.760676 2604 leader_election.cc:334] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:42:18.762737 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3391f089f71e447b9628bac16fe3443c in term 8.
I20260621 02:42:18.763223 2601 leader_election.cc:302] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3391f089f71e447b9628bac16fe3443c, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9
I20260621 02:42:18.763532 2680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 8 FOLLOWER]: Leader election won for term 8
I20260621 02:42:18.764014 2680 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [term 8 LEADER]: Becoming Leader. State: Replica: 3391f089f71e447b9628bac16fe3443c, State: Running, Role: LEADER
I20260621 02:42:18.764508 2680 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 7.123, Last appended by leader: 123, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:18.766978 2685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3391f089f71e447b9628bac16fe3443c. Latest consensus state: current_term: 8 leader_uuid: "3391f089f71e447b9628bac16fe3443c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:18.767335 2685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:18.768365 2687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:18.771692 2687 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:18.772194 2687 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:18.772542 2687 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:18.772837 2687 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:18.773090 2687 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:18.773412 2687 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:18.773744 2687 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:18.774015 2687 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:18.774390 2687 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:18.774897 2687 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:18.775151 2687 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:18.775516 2687 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:18.775797 2687 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:18.776079 2687 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:18.776350 2687 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:18.780016 2687 tablet_loader.cc:96] loaded metadata for tablet 1543eb0831ae452db2d85aa8e8659c4f (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:18.780366 2687 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:18.780807 2687 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:18.781481 2687 tablet_loader.cc:96] loaded metadata for tablet 3126b97849d0422e95211d2419e6abf3 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:18.782326 2687 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:18.783535 2687 tablet_loader.cc:96] loaded metadata for tablet 726112934f3b493f963e037a33f184c1 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:18.784196 2687 tablet_loader.cc:96] loaded metadata for tablet 86b1a4fe9c374ba1adb16b4c99811200 (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:18.784483 2687 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:18.784991 2687 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:18.785771 2687 tablet_loader.cc:96] loaded metadata for tablet aa8d4109be4d43b994ab3a2154a90ded (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:18.786059 2687 tablet_loader.cc:96] loaded metadata for tablet aaba3cc349d94544a7959d15d4cead98 (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:18.786495 2687 tablet_loader.cc:96] loaded metadata for tablet b3f34722963e45c0bebf87be46da8efd (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:18.787233 2687 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:18.787580 2687 tablet_loader.cc:96] loaded metadata for tablet d493adcd9e724684a0064d789ba565cc (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:18.788025 2687 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:18.788872 2687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:18.790688 2687 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:18.790803 2687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:18.793311 2687 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:18.794901 2687 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3391f089f71e447b9628bac16fe3443c: Loaded TSK: 0
I20260621 02:42:18.795827 2687 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:18.798102 2687 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:18.799831 2687 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:18.883993 2620 master_service.cc:946] ReplaceTablet: received request to replace tablet 5e49f47887e044668800410f7a7b72b4 from {username='slave'} at 127.0.0.1:39084
I20260621 02:42:18.884037 2619 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c4d7a76b39841988629f0db75f1f69e from {username='slave'} at 127.0.0.1:39084
I20260621 02:42:18.884415 2617 master_service.cc:946] ReplaceTablet: received request to replace tablet 67321be37d724469b620707de07c7f03 from {username='slave'} at 127.0.0.1:39084
I20260621 02:42:18.884657 2616 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d2fc2340c3d4e0d860c91205eaedf68 from {username='slave'} at 127.0.0.1:39084
I20260621 02:42:18.884200 2618 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_3548a6e62b27484d8fa771f8688ca8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.886036 2616 master_service.cc:946] ReplaceTablet: received request to replace tablet c09f475cc8fc487aba84bdba81d6ea97 from {username='slave'} at 127.0.0.1:39084
I20260621 02:42:18.886365 2620 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_608c53f32c054ee49c55bcf8ee3a7e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.886509 2619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:18.886826 2619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_7ef13b7647da48208cd992f8af548202" } modify_external_catalogs: true
I20260621 02:42:18.887681 2616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:18.887681 2617 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_522feae8f40d42578d1c405f347589bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.888185 2616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_3a337887b0124960a4309bf3ff5d2ed5" } modify_external_catalogs: true
I20260621 02:42:18.887981 2615 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_8b85797f61204810a499ef6b970dca59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.889272 2614 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_24e7a08d72a94d58a56750b388a7273a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.889428 2613 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39084:
name: "default.Table_0edb9612fcce47c99862ea3c6c864569"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:18.890261 2612 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:18.890563 2612 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_601222202f6f400f8d5b26bf198ae4d6" } modify_external_catalogs: true
I20260621 02:42:18.891363 2611 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39084:
table { table_name: "default.Table_faabbcd5060949a29d7f5c57526fb922" } new_table_name: "default.Table_5a92341192d44cc889170dcf2bdf23dc" modify_external_catalogs: true
I20260621 02:42:18.894227 2675 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
W20260621 02:42:18.894568 2675 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:18.895313 2675 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:18.895453 2675 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:18.895494 2675 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
@ 0x7f1ead03e9ad google::LogMessage::Fail() at ??:0
@ 0x7f1ead04188a google::LogMessage::SendToLog() at ??:0
@ 0x7f1ead03e4de google::LogMessage::Flush() at ??:0
@ 0x7f1ead03e6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f1ec2bdcba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f1ec2bdb901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f1ec2be266c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f1ec2be24e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1eafc68eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1eb2f426db start_thread at ??:0
@ 0x7f1eabed861f clone at ??:0
W20260621 02:42:19.108647 1318 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:19.108669 927 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:19.108973 1199 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:19.109341 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.61:35493)
W20260621 02:42:19.110001 1065 connection.cc:535] client connection to 127.0.97.61:35493 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:19.110100 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:19.110307 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.61:35493)
W20260621 02:42:19.110584 1318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.61:35493)
I20260621 02:42:19.703967 2461 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:19.704124 2461 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:20.903007 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--webserver_interface=127.0.97.62
--webserver_port=37371
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:42:21.250255 2708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:21.250617 2708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:21.250758 2708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:21.258237 2708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:21.258379 2708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:21.258490 2708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:21.258607 2708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:21.268819 2708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.62:44219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.97.62
--webserver_port=37371
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:21.270313 2708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:21.272104 2708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:21.283869 2713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:21.283896 2716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:21.284212 2714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:21.289105 2708 server_base.cc:1034] running on GCE node
I20260621 02:42:21.290302 2708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:21.292347 2708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:21.293628 2708 hybrid_clock.cc:648] HybridClock initialized: now 1782009741293552 us; error 41 us; skew 500 ppm
I20260621 02:42:21.293996 2708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:21.299425 2708 webserver.cc:460] Webserver started at http://127.0.97.62:37371/ using document root <none> and password file <none>
I20260621 02:42:21.300191 2708 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:21.300348 2708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:21.306197 2708 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260621 02:42:21.309423 2722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:21.310956 2708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260621 02:42:21.311160 2708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
uuid: "09161df32dff4fa18f1926765ea191d9"
format_stamp: "Formatted at 2026-06-21 02:41:50 on dist-test-slave-zz3r"
I20260621 02:42:21.312196 2708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:21.330873 2708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:21.331789 2708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:21.332093 2708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:21.350783 2708 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.62:44219
I20260621 02:42:21.350818 2773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.62:44219 every 8 connection(s)
I20260621 02:42:21.352232 2708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-0/data/info.pb
I20260621 02:42:21.355427 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2708
I20260621 02:42:21.359711 2774 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:21.364028 2774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap starting.
I20260621 02:42:21.385679 2774 log.cc:824] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:21.430462 1175 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:42:21.447326 1037 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:42:21.464293 1309 heartbeater.cc:347] Connected to a master server at 127.0.97.62:44219
I20260621 02:42:21.480527 2774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=122 overwritten=0 applied=122 ignored=0} inserts{seen=82 ignored=0} mutations{seen=101 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 02:42:21.481102 2774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Bootstrap complete.
I20260621 02:42:21.489266 2774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:21.490270 2774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Initialized, Role: FOLLOWER
I20260621 02:42:21.490883 2774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 122, Last appended: 6.122, Last appended by leader: 122, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:21.491704 2778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:21.492043 2778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:21.492766 2774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:21.508045 2792 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:21.508249 2792 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: loading cluster ID for follower catalog manager: success
I20260621 02:42:21.513567 2792 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: acquiring CA information for follower catalog manager: success
I20260621 02:42:21.517706 2792 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:21.515256 2708 master_runner.cc:186] Error getting master registration for 127.0.97.61:35493: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111),
I20260621 02:42:21.524659 2708 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:21.736068 2796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:21.736289 2796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:21.737015 2796 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:21.738991 2479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260621 02:42:21.748723 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:21.752632 2749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d142d25b86d4ad7935e806b7ebe8599" candidate_term: 9 candidate_status { last_received { term: 4 index: 116 } } ignore_live_leader: false dest_uuid: "09161df32dff4fa18f1926765ea191d9" is_pre_election: true
I20260621 02:42:21.753782 2749 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d142d25b86d4ad7935e806b7ebe8599 for term 9 because replica has last-logged OpId of term: 6 index: 122, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 116.
I20260621 02:42:21.754987 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:21.755339 2796 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260621 02:42:21.935458 2739 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:39953; Asking this server to re-register.
I20260621 02:42:21.936170 1175 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:21.937881 2739 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:21.950538 2739 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:59665; Asking this server to re-register.
I20260621 02:42:21.951325 1037 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:21.952950 2739 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:21.967633 2739 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:48729; Asking this server to re-register.
I20260621 02:42:21.968500 1309 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:21.970117 2739 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:22.105683 2800 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:22.105989 2800 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:22.107749 2800 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
W20260621 02:42:22.109203 2726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:42:22.111766 2726 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:22.115206 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 7 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:42:22.115512 2502 raft_consensus.cc:2354] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09161df32dff4fa18f1926765ea191d9 for earlier term 7. Current term is 8.
I20260621 02:42:22.116322 2723 leader_election.cc:398] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09161df32dff4fa18f1926765ea191d9 for earlier term 7. Current term is 8.
I20260621 02:42:22.116411 2723 leader_election.cc:401] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260621 02:42:22.117339 2800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 6 FOLLOWER]: Advancing to term 8
I20260621 02:42:22.121663 2800 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09161df32dff4fa18f1926765ea191d9 for earlier term 7. Current term is 8.
I20260621 02:42:22.734536 2812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:22.734776 2812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:22.735507 2812 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:22.736124 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 9 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599" is_pre_election: true
I20260621 02:42:22.736423 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 8.
I20260621 02:42:22.736987 2723 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599; no voters:
I20260621 02:42:22.737344 2812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260621 02:42:22.737519 2812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 02:42:22.737627 2812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 8 FOLLOWER]: Advancing to term 9
W20260621 02:42:22.738245 2726 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:22.740001 2812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:22.740661 2812 leader_election.cc:288] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 election: Requested vote from peers 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493), 5d142d25b86d4ad7935e806b7ebe8599 (127.0.97.60:39755)
I20260621 02:42:22.741192 2502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09161df32dff4fa18f1926765ea191d9" candidate_term: 9 candidate_status { last_received { term: 6 index: 122 } } ignore_live_leader: false dest_uuid: "5d142d25b86d4ad7935e806b7ebe8599"
I20260621 02:42:22.741472 2502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 8 FOLLOWER]: Advancing to term 9
W20260621 02:42:22.741873 2726 leader_election.cc:334] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:22.743417 2502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09161df32dff4fa18f1926765ea191d9 in term 9.
I20260621 02:42:22.743865 2723 leader_election.cc:302] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09161df32dff4fa18f1926765ea191d9, 5d142d25b86d4ad7935e806b7ebe8599; no voters: 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:22.744230 2812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 9 FOLLOWER]: Leader election won for term 9
I20260621 02:42:22.744657 2812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [term 9 LEADER]: Becoming Leader. State: Replica: 09161df32dff4fa18f1926765ea191d9, State: Running, Role: LEADER
I20260621 02:42:22.745157 2812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 6.122, Last appended by leader: 122, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:22.748083 2815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 9 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:22.748354 2815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [sys.catalog]: This master's current role is: LEADER
I20260621 02:42:22.748991 2817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260621 02:42:22.752049 2817 catalog_manager.cc:669] Loaded metadata for table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf]
I20260621 02:42:22.752556 2817 catalog_manager.cc:669] Loaded metadata for table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6]
I20260621 02:42:22.752898 2817 catalog_manager.cc:669] Loaded metadata for table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a]
I20260621 02:42:22.753247 2817 catalog_manager.cc:669] Loaded metadata for table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5]
I20260621 02:42:22.753623 2817 catalog_manager.cc:669] Loaded metadata for table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee]
I20260621 02:42:22.753984 2817 catalog_manager.cc:669] Loaded metadata for table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60]
I20260621 02:42:22.754513 2817 catalog_manager.cc:669] Loaded metadata for table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8]
I20260621 02:42:22.754901 2817 catalog_manager.cc:669] Loaded metadata for table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af]
I20260621 02:42:22.755371 2817 catalog_manager.cc:669] Loaded metadata for table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb]
I20260621 02:42:22.755954 2817 catalog_manager.cc:669] Loaded metadata for table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06]
I20260621 02:42:22.756278 2817 catalog_manager.cc:669] Loaded metadata for table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7]
I20260621 02:42:22.756722 2817 catalog_manager.cc:669] Loaded metadata for table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869]
I20260621 02:42:22.757148 2817 catalog_manager.cc:669] Loaded metadata for table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c]
I20260621 02:42:22.757552 2817 catalog_manager.cc:669] Loaded metadata for table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b]
I20260621 02:42:22.757959 2817 catalog_manager.cc:669] Loaded metadata for table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c]
I20260621 02:42:22.761174 2817 tablet_loader.cc:96] loaded metadata for tablet 1543eb0831ae452db2d85aa8e8659c4f (table default.table_784797b809be4d9287f0cd76cb9e1e39 [id=84f049860a63462a8cd099f8fc9e1cb7])
I20260621 02:42:22.761543 2817 tablet_loader.cc:96] loaded metadata for tablet 18a8243272f04644b9b5634181e47257 (table default.table_601222202f6f400f8d5b26bf198ae4d6 [id=00bcbcf024244266942dbcf393b15aaf])
I20260621 02:42:22.761924 2817 tablet_loader.cc:96] loaded metadata for tablet 22a484bc2d4e4488aa3575792b40ec62 (table default.table_becc7bbf75e442e3aff1f1b9b077cf00 [id=53bdfa6c20fb493c9f3cab22b7c3d8bb])
I20260621 02:42:22.762502 2817 tablet_loader.cc:96] loaded metadata for tablet 3126b97849d0422e95211d2419e6abf3 (table default.table_faabbcd5060949a29d7f5c57526fb922 [id=1e7ed454ee2e4656a7d7cc82a20fd3c5])
I20260621 02:42:22.762977 2817 tablet_loader.cc:96] loaded metadata for tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 (table default.table_9d5ad560ef6b47d1b30f5b78b7638733 [id=2bc21e717ceb45cfa1480e0a612f2f60])
I20260621 02:42:22.763710 2817 tablet_loader.cc:96] loaded metadata for tablet 726112934f3b493f963e037a33f184c1 (table default.table_712b123abad04ea6ac57e7b5d5af879b [id=234547ee10c2455ab7f7bf73231ad6ee])
I20260621 02:42:22.764297 2817 tablet_loader.cc:96] loaded metadata for tablet 86b1a4fe9c374ba1adb16b4c99811200 (table default.table_bc5bd36243f048bba4f16b19363408e5 [id=dbc52b96f80243fca9a0ccd2bd54df6c])
I20260621 02:42:22.764514 2817 tablet_loader.cc:96] loaded metadata for tablet 8d871d5f864449d3bf7551e46c912549 (table default.table_7ef13b7647da48208cd992f8af548202 [id=7ff55cda959244cfad148f8a52854c06])
I20260621 02:42:22.764849 2817 tablet_loader.cc:96] loaded metadata for tablet 908e00c0865749d2b19417e336888311 (table default.table_750a14e723cf445bbf3e12c70742fc7e [id=2c55bde9dda547d7a8f8c98ea85036e8])
I20260621 02:42:22.765585 2817 tablet_loader.cc:96] loaded metadata for tablet aa8d4109be4d43b994ab3a2154a90ded (table default.table_5a02f30d3adf4196b07934e402f06d8e [id=08614b84d17f4ac9914935c58756d1b6])
I20260621 02:42:22.765782 2817 tablet_loader.cc:96] loaded metadata for tablet aaba3cc349d94544a7959d15d4cead98 (table default.table_7316d10767b943a3972b1a92374e24c9 [id=be0cea43f4d54176acd5c9d8e1da394b])
I20260621 02:42:22.766201 2817 tablet_loader.cc:96] loaded metadata for tablet b3f34722963e45c0bebf87be46da8efd (table default.table_a150263b166249fa86e82c610ad9270b [id=0e8af313d74c4e2c95963ba86b90778a])
I20260621 02:42:22.766795 2817 tablet_loader.cc:96] loaded metadata for tablet d16abd1e360844519831cf81eda9a6e1 (table default.table_7a5f6439abf24a988873c3d9c7d71dd9 [id=99c5624d74204218be0a0a5c4a687869])
I20260621 02:42:22.767001 2817 tablet_loader.cc:96] loaded metadata for tablet d493adcd9e724684a0064d789ba565cc (table default.table_3a337887b0124960a4309bf3ff5d2ed5 [id=bd3fc7490a614e80a2e2a65e5f17a38c])
I20260621 02:42:22.767359 2817 tablet_loader.cc:96] loaded metadata for tablet dd3f3dc9ba764ccba687e4ef4773c6cd (table default.table_d0753d0b484d47f691d51bf949845520 [id=334d63b5eaaf48de9bc46f4473bea4af])
I20260621 02:42:22.768044 2817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260621 02:42:22.769977 2817 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:22.770069 2817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260621 02:42:22.772593 2817 catalog_manager.cc:1504] Loading token signing keys...
I20260621 02:42:22.774266 2817 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9: Loaded TSK: 0
I20260621 02:42:22.775159 2817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260621 02:42:22.776624 2817 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260621 02:42:22.778163 2817 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 33
I20260621 02:42:22.862105 2739 master_service.cc:946] ReplaceTablet: received request to replace tablet 18a8243272f04644b9b5634181e47257 from {username='slave'} at 127.0.0.1:50286
I20260621 02:42:22.862146 2738 master_service.cc:946] ReplaceTablet: received request to replace tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 from {username='slave'} at 127.0.0.1:50286
I20260621 02:42:22.862278 2737 master_service.cc:946] ReplaceTablet: received request to replace tablet 5e49f47887e044668800410f7a7b72b4 from {username='slave'} at 127.0.0.1:50286
I20260621 02:42:22.862882 2736 master_service.cc:946] ReplaceTablet: received request to replace tablet 475e1e2bcc3d4ac9a6cd03b78f737b66 from {username='slave'} at 127.0.0.1:50286
I20260621 02:42:22.863392 2735 master_service.cc:946] ReplaceTablet: received request to replace tablet 22a484bc2d4e4488aa3575792b40ec62 from {username='slave'} at 127.0.0.1:50286
I20260621 02:42:22.863905 2734 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_7316d10767b943a3972b1a92374e24c9" } new_table_name: "default.Table_99d895f423774b16bccf9a8c0a5671fe" modify_external_catalogs: true
I20260621 02:42:22.865103 2737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:22.865483 2737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_712b123abad04ea6ac57e7b5d5af879b" } modify_external_catalogs: true
I20260621 02:42:22.865581 2733 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50286:
name: "default.Table_66ba19cef5dc4906ad2b7f2946cac9cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 02:42:22.866350 2732 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:22.866703 2732 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_a150263b166249fa86e82c610ad9270b" } modify_external_catalogs: true
I20260621 02:42:22.866760 2730 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_65a5205e941c44c5bdc59e0846793cb3" } new_table_name: "default.Table_d0753d0b484d47f691d51bf949845520" modify_external_catalogs: true
I20260621 02:42:22.867307 2731 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50286:
table { table_name: "default.Table_55949c61dce74206ba47a1657f192207" } new_table_name: "default.Table_9d5ad560ef6b47d1b30f5b78b7638733" modify_external_catalogs: true
W20260621 02:42:22.872996 2726 consensus_peers.cc:487] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 -> Peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Couldn't send request to peer 3391f089f71e447b9628bac16fe3443c. Status: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 02:42:22.879858 2502 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Refusing update from remote peer 09161df32dff4fa18f1926765ea191d9: Log matching property violated. Preceding OpId in replica: term: 4 index: 116. Preceding OpId from leader: term: 9 index: 125. (index mismatch)
I20260621 02:42:22.882905 2812 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 115, Time since last communication: 0.000s
I20260621 02:42:22.883152 2791 catalog_manager.cc:2709] Deleting table default.table_3548a6e62b27484d8fa771f8688ca8af [id=c8f2e71516fc4297ac8177de874b068a] in response to Hive Metastore notification log event 34
I20260621 02:42:22.883369 2812 consensus_queue.cc:1225] T 00000000000000000000000000000000 P 09161df32dff4fa18f1926765ea191d9 [LEADER]: Peer 5d142d25b86d4ad7935e806b7ebe8599 log is divergent from this leader: its last log entry 4.116 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 115
W20260621 02:42:22.883627 2791 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 34 DROP_TABLE default.table_3548a6e62b27484d8fa771f8688ca8af: Not found: the table does not exist: table_id: "c8f2e71516fc4297ac8177de874b068a" table_name: "default.table_3548a6e62b27484d8fa771f8688ca8af"
I20260621 02:42:22.884948 2791 catalog_manager.cc:2709] Deleting table default.table_5ca503a3c4ba46a6bda089bf52d0f837 [id=ab550098ce024fc98d309badd2c7f1ef] in response to Hive Metastore notification log event 35
W20260621 02:42:22.885200 2791 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 35 DROP_TABLE default.table_5ca503a3c4ba46a6bda089bf52d0f837: Not found: the table does not exist: table_id: "ab550098ce024fc98d309badd2c7f1ef" table_name: "default.table_5ca503a3c4ba46a6bda089bf52d0f837"
F20260621 02:42:22.885275 2791 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 35): 35 ALTER_TABLE default.table_5a92341192d44cc889170dcf2bdf23dc
*** Check failure stack trace: ***
@ 0x7fb437e0d9ad google::LogMessage::Fail() at ??:0
I20260621 02:42:22.889004 2502 pending_rounds.cc:76] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Aborting all ops after (but not including) 115
@ 0x7fb437e1088a google::LogMessage::SendToLog() at ??:0
I20260621 02:42:22.889161 2502 pending_rounds.cc:97] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Aborting uncommitted WRITE_OP operation due to leader change: 4.116
@ 0x7fb437e0d4de google::LogMessage::Flush() at ??:0
@ 0x7fb437e0d6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fb44d9abba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fb44d9aa901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fb44d9b166c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fb44d9b14e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb43aa37eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb43dd116db start_thread at ??:0
@ 0x7fb436ca761f clone at ??:0
I20260621 02:42:22.945941 2825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:22.946755 2825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:22.946455 2821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09161df32dff4fa18f1926765ea191d9. Latest consensus state: current_term: 9 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:22.946923 2821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:22.944765 2831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "09161df32dff4fa18f1926765ea191d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:22.947038 2831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
W20260621 02:42:23.144858 2478 connection.cc:535] server connection from 127.0.0.1:47916 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:23.144889 927 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:23.145043 1199 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:23.145467 1065 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:23.145516 1318 connection.cc:535] client connection to 127.0.97.62:44219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260621 02:42:23.146299 1318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.97.62:44219)
W20260621 02:42:23.146576 1318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.97.62:44219)
W20260621 02:42:23.146788 1318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.97.62:44219)
W20260621 02:42:23.146977 1318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.97.62:44219)
I20260621 02:42:23.393134 2831 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09161df32dff4fa18f1926765ea191d9)
I20260621 02:42:23.393323 2831 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:23.394042 2831 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:23.396610 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:23.396867 2479 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:23.396991 2479 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:23.397251 2831 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:23.861168 388 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu pid 2461
I20260621 02:42:23.869220 2522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260621 02:42:24.000793 388 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu with pid 2461
I20260621 02:42:24.935575 388 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
/tmp/dist-test-taskLUPbWb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--webserver_interface=127.0.97.60
--webserver_port=39369
--builtin_ntp_servers=127.0.97.20:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260621 02:42:25.274833 2853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260621 02:42:25.275149 2853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260621 02:42:25.275310 2853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260621 02:42:25.284653 2853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260621 02:42:25.284780 2853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260621 02:42:25.284888 2853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260621 02:42:25.284987 2853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260621 02:42:25.295195 2853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.97.20:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.97.60:39755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.97.60
--webserver_port=39369
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 21 Jun 2026 01:47:56 UTC on ccycloud.quasar-luwggy.root.comops.site
build id 4457866
ASAN enabled
I20260621 02:42:25.296914 2853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 02:42:25.298987 2853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260621 02:42:25.312613 2858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:25.312641 2859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 02:42:25.312973 2861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 02:42:25.313632 2853 server_base.cc:1034] running on GCE node
I20260621 02:42:25.314592 2853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260621 02:42:25.316561 2853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260621 02:42:25.317854 2853 hybrid_clock.cc:648] HybridClock initialized: now 1782009745317783 us; error 52 us; skew 500 ppm
I20260621 02:42:25.318264 2853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260621 02:42:25.320777 2853 webserver.cc:460] Webserver started at http://127.0.97.60:39369/ using document root <none> and password file <none>
I20260621 02:42:25.321624 2853 fs_manager.cc:359] Metadata directory not provided
I20260621 02:42:25.321779 2853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 02:42:25.327566 2853 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260621 02:42:25.330917 2867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 02:42:25.332468 2853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260621 02:42:25.332674 2853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data,/tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
uuid: "5d142d25b86d4ad7935e806b7ebe8599"
format_stamp: "Formatted at 2026-06-21 02:41:51 on dist-test-slave-zz3r"
I20260621 02:42:25.333818 2853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 02:42:25.355721 2853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260621 02:42:25.356629 2853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 02:42:25.356926 2853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 02:42:25.376770 2853 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.60:39755
I20260621 02:42:25.376781 2918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.60:39755 every 8 connection(s)
I20260621 02:42:25.378383 2853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskLUPbWb/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1782009695271281-388-0/minicluster-data/master-2/data/info.pb
I20260621 02:42:25.384936 2919 sys_catalog.cc:263] Verifying existing consensus state
I20260621 02:42:25.385843 388 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskLUPbWb/build/asan/bin/kudu as pid 2853
I20260621 02:42:25.389637 2919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap starting.
I20260621 02:42:25.415107 2919 log.cc:824] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Log is configured to *not* fsync() on all Append() calls
I20260621 02:42:25.507848 2919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap replayed 1/1 log segments. Stats: ops{read=126 overwritten=1 applied=122 ignored=0} inserts{seen=82 ignored=0} mutations{seen=101 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260621 02:42:25.508527 2919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: Bootstrap complete.
I20260621 02:42:25.516378 2919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:25.519934 2919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d142d25b86d4ad7935e806b7ebe8599, State: Initialized, Role: FOLLOWER
I20260621 02:42:25.520661 2919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 122, Last appended: 9.125, Last appended by leader: 125, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:25.521544 2924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } } }
I20260621 02:42:25.521862 2924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: This master's current role is: FOLLOWER
I20260621 02:42:25.522660 2919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 02:42:25.539402 1174 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:25.547441 1036 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:25.548610 1308 heartbeater.cc:347] Connected to a master server at 127.0.97.60:39755
I20260621 02:42:25.554221 2883 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "35b23c9f06314e4abf6d8aff8989e73e" instance_seqno: 1782009712869608) as {username='slave'} at 127.0.97.1:49383; Asking this server to re-register.
I20260621 02:42:25.552166 2884 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a2d4d8ec6f9845f5bbfca1390740aedc" instance_seqno: 1782009713889617) as {username='slave'} at 127.0.97.3:46081; Asking this server to re-register.
I20260621 02:42:25.555313 1308 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:25.558144 2884 ts_manager.cc:194] Registered new tserver with Master: a2d4d8ec6f9845f5bbfca1390740aedc (127.0.97.3:36259)
I20260621 02:42:25.559584 2941 catalog_manager.cc:1259] Loaded cluster ID: ad999256732b4af1b29507543e9e38ff
I20260621 02:42:25.559754 2941 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: loading cluster ID for follower catalog manager: success
I20260621 02:42:25.565187 2941 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: acquiring CA information for follower catalog manager: success
I20260621 02:42:25.570691 1036 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:25.572815 2884 ts_manager.cc:194] Registered new tserver with Master: 35b23c9f06314e4abf6d8aff8989e73e (127.0.97.1:46793)
I20260621 02:42:25.570813 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:25.578299 2941 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 02:42:25.578624 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:25.974278 2924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:25.974589 2924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:25.976784 2924 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:25.977527 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:25.979241 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:25.979444 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:25.979532 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:25.979843 2924 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:26.045854 2884 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6f52030a7bb641f883dba1ffbd912dba" instance_seqno: 1782009713383050) as {username='slave'} at 127.0.97.2:32915; Asking this server to re-register.
I20260621 02:42:26.046447 1174 heartbeater.cc:464] Registering TS with master...
I20260621 02:42:26.048416 2884 ts_manager.cc:194] Registered new tserver with Master: 6f52030a7bb641f883dba1ffbd912dba (127.0.97.2:42873)
I20260621 02:42:26.630271 2947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:26.630607 2947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:26.631995 2947 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:26.634577 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:26.634832 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:26.634960 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:26.635252 2947 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:27.466216 2952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:27.466400 2952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:27.466961 2952 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:27.469352 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:27.469597 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:27.469679 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:27.469898 2952 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:27.656517 388 master-stress-test.cc:578] Killing test thread 1/25
I20260621 02:42:27.991204 2958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:27.991384 2958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:27.991957 2958 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:27.994380 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:27.994611 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:27.994730 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:27.995034 2958 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:28.586787 2962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:28.587047 2962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:28.587767 2962 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:28.590267 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:28.590515 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:28.590601 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:28.590813 2962 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:30.580125 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:30.580380 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:31.750854 2969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:31.751111 2969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:31.751789 2969 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:31.752955 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260621 02:42:31.754390 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:31.754630 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:31.754781 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:31.755026 2969 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:35.581866 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:35.582088 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:36.939682 2980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:36.940014 2980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:36.940761 2980 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:36.941920 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:42:36.943691 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:36.943907 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:36.943997 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:36.944207 2980 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:40.583688 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:40.583907 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:40.640626 2990 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:40.640841 2990 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:40.641475 2990 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:40.643538 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:40.643754 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:40.643908 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:40.644150 2990 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:42.811894 2993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:42.812316 2993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:42.813009 2993 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:42.814580 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:42:42.816004 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:42.816228 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:42.816351 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:42.816716 2993 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:44.809144 2997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:42:44.809444 2997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:42:44.810071 2997 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:42:44.814393 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:42:44.814615 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:44.814702 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:42:44.814926 2997 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:42:45.585649 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:45.585963 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:42:50.587456 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:50.587656 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:42:54.704234 1310 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (71 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:42:54.704283 1038 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (71 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:42:54.704262 1176 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (71 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:42:55.589885 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:42:55.590301 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:00.528426 3025 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:00.528638 3025 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:00.529663 3025 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:00.530886 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:43:00.532405 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:00.532651 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:00.532755 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:00.533147 3025 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:00.591960 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:00.592212 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:05.594276 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:05.594504 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:10.595971 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:10.596153 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:11.138110 3039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:11.138322 3039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:11.138990 3039 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:11.140568 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:43:11.142163 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:11.142406 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:11.142508 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:11.142824 3039 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:13.447419 3046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:13.447700 3046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:13.448797 3046 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:13.452832 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:13.453058 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:13.453199 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:13.453596 3046 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:15.597887 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:15.598150 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:20.599917 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:20.600163 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:23.843020 3061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:23.843226 3061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:23.843813 3061 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:23.845193 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:43:23.846812 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:23.847040 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:23.847144 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:23.847427 3061 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:25.601917 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:25.602171 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:30.603713 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:30.603969 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:34.197186 3074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:34.197502 3074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:34.198244 3074 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:34.199571 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:43:34.200960 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:34.201181 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:34.201318 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:34.201751 3074 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:35.605612 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:35.605827 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:40.607478 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:40.607698 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:45.610167 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:45.610414 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:43:48.953119 3097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:43:48.953322 3097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:43:48.953997 3097 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:43:48.955008 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:43:48.956496 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:43:48.956709 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:48.956804 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:43:48.957015 3097 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:43:50.612042 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:50.612238 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:43:54.862534 1038 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (191 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:43:54.862692 1310 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (191 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:43:54.862681 1176 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (191 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:43:55.613961 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:43:55.614164 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:00.616113 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:00.616359 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:02.574563 3114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:02.574792 3114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:02.575438 3114 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:02.576668 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:44:02.578513 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:02.578819 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:02.578951 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:02.579232 3114 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:05.618086 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:05.618338 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:10.620005 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:10.620291 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:15.622038 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:15.622284 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:17.839476 3135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:17.839726 3135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:17.840713 3135 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:17.842377 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:44:17.846328 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:17.846540 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:17.846662 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:17.846956 3135 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:20.627020 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:20.627204 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:25.551362 2873 maintenance_manager.cc:419] P 5d142d25b86d4ad7935e806b7ebe8599: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033341
I20260621 02:44:25.613276 2872 maintenance_manager.cc:643] P 5d142d25b86d4ad7935e806b7ebe8599: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.061s user 0.023s sys 0.009s Metrics: {"bytes_written":23713,"cfile_init":1,"dirs.queue_time_us":760,"dirs.run_cpu_time_us":273,"dirs.run_wall_time_us":1000,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":754,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":66,"thread_start_us":721,"threads_started":2,"wal-append.queue_time_us":433}
I20260621 02:44:25.614748 2873 maintenance_manager.cc:419] P 5d142d25b86d4ad7935e806b7ebe8599: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4993 bytes on disk
I20260621 02:44:25.615581 2872 maintenance_manager.cc:643] P 5d142d25b86d4ad7935e806b7ebe8599: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20260621 02:44:25.628834 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:25.629097 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:30.630908 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:30.631242 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:33.708812 3177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:33.709065 3177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:33.709968 3177 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:33.711519 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:44:33.713042 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:33.713274 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:33.713424 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:33.713718 3177 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:35.632907 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:35.633162 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:36.031683 3192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:36.031916 3192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:36.032728 3192 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:36.039974 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:36.040148 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:36.040258 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:36.040486 3192 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:40.634800 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:40.635054 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:40.749191 3218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:40.749455 3218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:40.750041 3218 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:40.751014 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:44:40.752432 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:40.752668 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:40.752799 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:40.753113 3218 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:41.864517 3226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:41.864727 3226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:41.865494 3226 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:41.867858 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:41.868048 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:41.868135 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:41.868417 3226 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:44:45.636586 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:45.636770 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:50.638482 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:50.638695 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:44:55.024390 1038 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (311 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:44:55.024598 1310 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (311 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:44:55.024660 1176 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (311 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:55.640240 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:44:55.640434 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:44:57.073673 3298 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:44:57.073889 3298 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:44:57.074697 3298 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:44:57.075742 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:44:57.077004 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:44:57.077145 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:44:57.077230 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:44:57.077467 3298 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:45:00.642592 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:00.642791 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:05.644322 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:05.644518 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:10.646507 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:10.646739 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:14.700790 3497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:45:14.701014 3497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:45:14.701918 3497 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:45:14.703379 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:45:14.704948 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:45:14.705149 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:45:14.705284 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:45:14.705641 3497 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:45:15.648416 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:15.648660 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:20.650192 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:20.650380 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:25.652169 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:25.652374 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:30.654204 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:30.654434 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:32.165166 3751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:45:32.165481 3751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:45:32.166339 3751 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:45:32.174638 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:45:32.176132 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:45:32.176366 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:45:32.176499 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:45:32.176841 3751 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:45:35.656354 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:35.656551 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:40.658233 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:40.658458 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:45.660190 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:45.660403 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:50.662117 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:50.662357 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:45:51.346563 4022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:45:51.346830 4022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:45:51.347716 4022 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:45:51.349642 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:45:51.351161 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:45:51.351326 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:45:51.351408 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:45:51.351624 4022 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260621 02:45:55.227280 1175 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (423 consecutive failures): Network error: Failed to ping master at 127.0.97.62:44219: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:45:55.227280 1176 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (431 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:45:55.243468 1037 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (423 consecutive failures): Network error: Failed to ping master at 127.0.97.62:44219: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:45:55.243618 1309 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (423 consecutive failures): Network error: Failed to ping master at 127.0.97.62:44219: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
I20260621 02:45:55.663784 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:45:55.664057 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:00.665797 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:00.666042 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:05.667542 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:05.667753 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:10.669684 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:10.669881 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:10.774859 4305 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:10.775084 4305 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:10.775960 4305 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:10.776921 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:46:10.778594 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:10.778807 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:10.778935 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:10.779202 4305 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:46:15.077739 4369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:15.078023 4369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:15.078675 4369 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:15.082010 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:15.082226 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:15.082325 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:15.082646 4369 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:46:15.671304 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:15.671553 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:18.847170 4434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:18.847422 4434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:18.848022 4434 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:18.849156 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:46:18.850495 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:18.850713 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:18.850818 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:18.851145 4434 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:46:20.673326 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:20.673633 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:25.675505 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:25.675796 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:26.917106 4551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:26.917325 4551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:26.917991 4551 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:26.919371 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:46:26.920667 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:26.920878 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:26.920959 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:26.921162 4551 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:46:30.677657 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:30.677893 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:35.679579 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:35.679831 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:40.681318 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:40.681656 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:43.001941 4779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:43.002220 4779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:43.003512 4779 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:43.004989 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:46:43.006384 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:43.006695 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:43.006785 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:43.006999 4779 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:46:45.685149 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:45.685442 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:50.687068 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:50.687292 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:51.745616 4901 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:51.745882 4901 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:51.746541 4901 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:51.747818 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:46:51.750780 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:51.751027 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:51.751147 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:51.751370 4901 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260621 02:46:55.440066 1175 heartbeater.cc:644] Failed to heartbeat to 127.0.97.62:44219 (543 consecutive failures): Network error: Failed to ping master at 127.0.97.62:44219: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:55.478353 1038 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (551 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:46:55.478739 1310 heartbeater.cc:644] Failed to heartbeat to 127.0.97.61:35493 (551 consecutive failures): Network error: Failed to ping master at 127.0.97.61:35493: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:55.691139 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:46:55.691329 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:46:55.988359 4968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:46:55.988675 4968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:46:55.989411 4968 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:46:55.991767 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:46:55.992014 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:46:55.992168 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:46:55.992494 4968 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:47:00.693039 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:47:00.693249 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:47:01.780643 5046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:47:01.780921 5046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:47:01.781749 5046 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:47:01.782930 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260621 02:47:01.786377 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:47:01.786599 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:47:01.786720 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:47:01.786990 5046 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:47:05.694998 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:47:05.695247 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:47:07.887559 2873 maintenance_manager.cc:419] P 5d142d25b86d4ad7935e806b7ebe8599: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4993 bytes on disk
I20260621 02:47:07.892763 2872 maintenance_manager.cc:643] P 5d142d25b86d4ad7935e806b7ebe8599: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.000s sys 0.004s Metrics: {"dirs.queue_time_us":403,"thread_start_us":574,"threads_started":2,"wal-append.queue_time_us":436}
I20260621 02:47:10.696883 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:47:10.697152 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:47:15.698907 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:47:15.699126 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260621 02:47:19.469094 5289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 02:47:19.469326 5289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09161df32dff4fa18f1926765ea191d9" member_type: VOTER last_known_addr { host: "127.0.97.62" port: 44219 } } peers { permanent_uuid: "3391f089f71e447b9628bac16fe3443c" member_type: VOTER last_known_addr { host: "127.0.97.61" port: 35493 } } peers { permanent_uuid: "5d142d25b86d4ad7935e806b7ebe8599" member_type: VOTER last_known_addr { host: "127.0.97.60" port: 39755 } }
I20260621 02:47:19.470167 5289 leader_election.cc:288] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219), 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493)
W20260621 02:47:19.471454 2871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260621 02:47:19.472987 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09161df32dff4fa18f1926765ea191d9 (127.0.97.62:44219): Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111)
W20260621 02:47:19.473186 2871 leader_election.cc:334] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3391f089f71e447b9628bac16fe3443c (127.0.97.61:35493): Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
I20260621 02:47:19.473308 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d142d25b86d4ad7935e806b7ebe8599; no voters: 09161df32dff4fa18f1926765ea191d9, 3391f089f71e447b9628bac16fe3443c
I20260621 02:47:19.473688 5289 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d142d25b86d4ad7935e806b7ebe8599 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260621 02:47:20.700860 2853 master_runner.cc:186] Error getting master registration for 127.0.97.62:44219: Network error: Client connection negotiation failed: client connection to 127.0.97.62:44219: connect: Connection refused (error 111),
I20260621 02:47:20.701107 2853 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260621 02:47:23.535099 1318 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:47:23.535348 1318 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:47:23.535439 1318 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
W20260621 02:47:23.535517 1318 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
F20260621 02:47:23.546627 1345 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
*** Aborted at 1782010043 (unix time) try "date -d @1782010043" if you are using GNU date ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status:
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status:
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000184) received by PID 388 (TID 0x7f563c2ce700) from PID 388; stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status:
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554631 1339 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554631 1339 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554788 1326 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f380223331ea479893e63d4d53570bed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554631 1339 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554788 1326 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f380223331ea479893e63d4d53570bed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.555106 1333 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f565516ea46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554631 1339 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554788 1326 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f380223331ea479893e63d4d53570bed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.555106 1333 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.556393 1327 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260621 02:47:23.556396 1334 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_66ba19cef5dc4906ad2b7f2946cac9cd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260621 02:47:23.547096 1325 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5ca503a3c4ba46a6bda089bf52d0f837 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.
7199 1344 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.547101 1340 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548194 1343 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548255 1330 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3548a6e62b27484d8fa771f8688ca8af on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.548470 1346 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549681 1332 master-stress-test.cc:352] Check failed: _s.ok() Bad status: FTimed out: Error creating table default.Table_6217ff360f914564a1fee8cacc9c1e2a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 0621 02:47:23.549716 1341 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.549968 1337 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551146 1338 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551517 1324 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_24e7a08d72a94d58a56750b388a7273a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.551527 1323 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_522feae8f40d42578d1c405f347589bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) 1336 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.552731 1335 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553042 1331 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_608c53f32c054ee49c55bcf8ee3a7e46 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.553090 1328 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8b85797f61204810a499ef6b970dca59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554114 1342 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554232 1349 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260621Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111) :23.554242 1329 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0edb9612fcce47c99862ea3c6c864569 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554631 1339 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.554788 1326 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f380223331ea479893e63d4d53570bed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.555106 1333 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)F20260621 02:47:23.556393 1327 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260621 02:47:23.556396 1334 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_66ba19cef5dc4906ad2b7f2946cac9cd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.97.62:44219,127.0.97.61:35493,127.0.97.60:39755, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.97.61:35493: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f56592b0980 (unknown) at ??:0
@ 0x7f565249ce87 gsignal at ??:0
@ 0x7f565249e7f1 abort at ??:0
@ 0x7f56551609ad google::LogMessage::Fail() at ??:0
@ 0x7f565516388a google::LogMessage::SendToLog() at ??:0
@ 0x7f56551604de google::LogMessage::Flush() at ??:0
@ 0x7f5655161a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x405f4e kudu::MasterStressTest::ReplaceTabletThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:392
@ 0x444b44 std::__invoke_impl<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:73
@ 0x4449fd std::__invoke<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:95
@ 0x4449ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:244
@ 0x44496e std::thread::_Invoker<>::operator()() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:253
@ 0x4446a9 std::thread::_State_impl<>::_M_run() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:196
@ 0x7f565dbeca4f execute_native_thread_routine at ??:0
@ 0x7f56592a56db start_thread at ??:0
@ 0x7f565257f61f clone at ??:0