Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260925 04:54:12.797739 9542 test_util.cc:268] Using random seed: -2114866948
2026-09-25T04:54:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-25T04:54:12Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskn1Fdef/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskn1Fdef/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/security.properties
2026-09-25 04:54:18: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskn1Fdef/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskn1Fdef/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260925 04:54:25.885970 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--webserver_interface=127.9.81.190
--webserver_port=0
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 04:54:26.195084 9782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:26.195363 9782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:26.195436 9782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:26.202435 9782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:26.202531 9782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:26.202636 9782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:26.202733 9782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:26.211767 9782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.81.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:26.213096 9782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:26.214836 9782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:26.226508 9790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:26.226588 9787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:26.226558 9788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:26.227312 9782 server_base.cc:1034] running on GCE node
I20260925 04:54:26.228036 9782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:26.229493 9782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:26.230737 9782 hybrid_clock.cc:648] HybridClock initialized: now 1790312066230689 us; error 29 us; skew 500 ppm
I20260925 04:54:26.231061 9782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:26.236349 9782 webserver.cc:460] Webserver started at http://127.9.81.190:33381/ using document root <none> and password file <none>
I20260925 04:54:26.237099 9782 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:26.237237 9782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:26.237540 9782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:26.240048 9782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/instance:
uuid: "37499e1d150b41169507d4dd098579b5"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.240796 9782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal/instance:
uuid: "37499e1d150b41169507d4dd098579b5"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.245841 9782 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260925 04:54:26.248915 9796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:26.250162 9782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260925 04:54:26.250347 9782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
uuid: "37499e1d150b41169507d4dd098579b5"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.250530 9782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:26.278548 9782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:26.279338 9782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:26.279631 9782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:26.296913 9782 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.190:37617
I20260925 04:54:26.296949 9847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.190:37617 every 8 connection(s)
I20260925 04:54:26.298188 9782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
I20260925 04:54:26.301751 9848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:26.302460 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 9782
I20260925 04:54:26.302754 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal/instance
I20260925 04:54:26.305871 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--webserver_interface=127.9.81.189
--webserver_port=0
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:26.310660 9848 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:26.329321 9848 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
W20260925 04:54:26.330385 9799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:26.331970 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:26.381407 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } attempt: 1
W20260925 04:54:26.383349 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:26.451659 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } attempt: 2
W20260925 04:54:26.453814 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:26.545193 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } attempt: 3
W20260925 04:54:26.547061 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:26.617982 9849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:26.618321 9849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:26.618463 9849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:26.625649 9849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:26.625780 9849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:26.625880 9849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:26.625988 9849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:26.634964 9849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.81.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:26.636283 9849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:26.638068 9849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:26.649588 9857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:26.649549 9860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:26.649619 9858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:26.650488 9849 server_base.cc:1034] running on GCE node
I20260925 04:54:26.651209 9849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:26.652493 9849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:26.653724 9849 hybrid_clock.cc:648] HybridClock initialized: now 1790312066653655 us; error 47 us; skew 500 ppm
I20260925 04:54:26.654045 9849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:26.656198 9849 webserver.cc:460] Webserver started at http://127.9.81.189:36963/ using document root <none> and password file <none>
I20260925 04:54:26.656857 9849 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:26.657052 9849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:26.657361 9849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:26.659840 9849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/instance:
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.660568 9849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal/instance:
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.665380 9849 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260925 04:54:26.668503 9866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:26.669759 9849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260925 04:54:26.669945 9849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:26.670128 9849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:26.687721 9849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:26.688572 9849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:26.688870 9849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:26.690285 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } attempt: 4
W20260925 04:54:26.692240 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:26.707348 9849 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.189:45475
I20260925 04:54:26.707371 9917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.189:45475 every 8 connection(s)
I20260925 04:54:26.708679 9849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
I20260925 04:54:26.712374 9918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:26.712553 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 9849
I20260925 04:54:26.712709 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal/instance
I20260925 04:54:26.714056 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--webserver_interface=127.9.81.188
--webserver_port=0
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:26.720391 9918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:26.734357 9918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:26.743518 9918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } has no permanent_uuid. Determining permanent_uuid...
W20260925 04:54:26.744637 9870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:26.746183 9918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:26.795506 9918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 1
W20260925 04:54:26.797502 9918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:26.865795 9918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 2
W20260925 04:54:26.867702 9918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:26.958967 9918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 3
W20260925 04:54:26.960834 9918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:26.991887 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } attempt: 5
I20260925 04:54:26.998436 9848 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } has no permanent_uuid. Determining permanent_uuid...
W20260925 04:54:27.000744 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:27.030413 9919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:27.030769 9919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:27.030910 9919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:27.037966 9919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:27.038097 9919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:27.038194 9919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:27.038306 9919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:27.047668 9919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.81.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:27.049041 9919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:27.050761 9919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260925 04:54:27.051980 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 1
W20260925 04:54:27.053879 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:27.063436 9928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:27.063467 9930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:27.063512 9927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:27.064344 9919 server_base.cc:1034] running on GCE node
I20260925 04:54:27.065203 9919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:27.066509 9919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:27.067744 9919 hybrid_clock.cc:648] HybridClock initialized: now 1790312067067696 us; error 47 us; skew 500 ppm
I20260925 04:54:27.068079 9919 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:27.070313 9919 webserver.cc:460] Webserver started at http://127.9.81.188:37703/ using document root <none> and password file <none>
I20260925 04:54:27.070982 9919 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:27.071120 9919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:27.071431 9919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:27.075532 9919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/instance:
uuid: "39da3a5fade344af9db436d10052b4bc"
format_stamp: "Formatted at 2026-09-25 04:54:27 on dist-test-slave-qkh6"
I20260925 04:54:27.076256 9919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal/instance:
uuid: "39da3a5fade344af9db436d10052b4bc"
format_stamp: "Formatted at 2026-09-25 04:54:27 on dist-test-slave-qkh6"
I20260925 04:54:27.081169 9919 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260925 04:54:27.084314 9936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:27.085606 9919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:27.085794 9919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
uuid: "39da3a5fade344af9db436d10052b4bc"
format_stamp: "Formatted at 2026-09-25 04:54:27 on dist-test-slave-qkh6"
I20260925 04:54:27.085989 9919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:27.100924 9919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:27.101725 9919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:27.101979 9919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:27.104066 9918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 4
W20260925 04:54:27.106132 9918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:27.122102 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 2
W20260925 04:54:27.124130 9848 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:27.124468 9919 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.188:40705
I20260925 04:54:27.124490 9987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.188:40705 every 8 connection(s)
I20260925 04:54:27.125912 9919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
I20260925 04:54:27.129498 9988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:27.130776 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 9919
I20260925 04:54:27.130976 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal/instance
I20260925 04:54:27.136107 9988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:27.151211 9988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:27.158705 9988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } has no permanent_uuid. Determining permanent_uuid...
I20260925 04:54:27.171798 9988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap starting.
I20260925 04:54:27.175107 9988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:27.176429 9988 log.cc:824] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:27.178632 9988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: No bootstrap required, opened a new log
I20260925 04:54:27.185734 9988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.186436 9988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:27.186554 9988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Initialized, Role: FOLLOWER
I20260925 04:54:27.187083 9988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.187754 9996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.188040 9996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.189139 9988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: configured and running, proceeding with master startup.
W20260925 04:54:27.201015 10010 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 04:54:27.201224 10010 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 04:54:27.197908 9919 master_runner.cc:186] Error getting master registration for 127.9.81.190:37617: OK, instance_id { permanent_uuid: "37499e1d150b41169507d4dd098579b5" instance_seqno: 1790312066292196 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260925 04:54:27.207918 9919 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:27.230394 9848 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 3
I20260925 04:54:27.244313 9848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap starting.
I20260925 04:54:27.249450 9848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:27.255064 9848 log.cc:824] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:27.265130 9848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: No bootstrap required, opened a new log
I20260925 04:54:27.276199 9848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.276559 9848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:27.276724 9848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37499e1d150b41169507d4dd098579b5, State: Initialized, Role: FOLLOWER
I20260925 04:54:27.277397 9848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.278337 10014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.278811 10014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.279587 9848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: configured and running, proceeding with master startup.
W20260925 04:54:27.282238 9802 tablet.cc:2369] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260925 04:54:27.311700 10029 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 04:54:27.311964 10029 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 04:54:27.294894 9782 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: OK, instance_id { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" instance_seqno: 1790312066702259 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260925 04:54:27.318734 9782 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260925 04:54:27.353919 9942 tablet.cc:2369] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 04:54:27.405339 9918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } attempt: 5
I20260925 04:54:27.418360 9918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap starting.
I20260925 04:54:27.422466 9918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:27.423812 9918 log.cc:824] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:27.427584 9918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: No bootstrap required, opened a new log
I20260925 04:54:27.439067 9918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.439435 9918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:27.439589 9918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Initialized, Role: FOLLOWER
I20260925 04:54:27.440220 9918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.441180 10032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.441646 10032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.442520 9918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:27.475697 9849 master_runner.cc:263] No leader master found from master 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:27.475867 9849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260925 04:54:27.498736 10047 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 04:54:27.498937 10047 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 04:54:27.558188 9996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:27.558507 9996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.560182 9996 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
I20260925 04:54:27.561308 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:27.561897 9823 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 0.
I20260925 04:54:27.562664 9939 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc; no voters:
I20260925 04:54:27.563380 9996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:27.563524 9996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:27.563617 9996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:27.563666 9893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:27.564247 9893 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 0.
I20260925 04:54:27.567399 9996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.568449 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5"
I20260925 04:54:27.568639 9823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:27.572211 9823 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 1.
I20260925 04:54:27.572645 9939 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc; no voters:
I20260925 04:54:27.574957 9996 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 1 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
I20260925 04:54:27.575426 9996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:27.575789 9996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 LEADER]: Becoming Leader. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Running, Role: LEADER
I20260925 04:54:27.576750 9996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:27.590515 9893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc"
I20260925 04:54:27.590780 9893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:27.594197 9893 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 1.
I20260925 04:54:27.595129 10049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.596055 10049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:27.602905 10051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:27.605866 10051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:27.629024 9893 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Refusing update from remote peer 39da3a5fade344af9db436d10052b4bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 04:54:27.630137 10049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:27.637252 9823 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Refusing update from remote peer 39da3a5fade344af9db436d10052b4bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 04:54:27.638074 10049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:27.663329 10032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.663668 10032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.666142 10014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.666399 10014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.667344 10053 mvcc.cc:205] Tried to move back new op lower bound from 7333118228987887616 to 7333118228807536640. Current Snapshot: MvccSnapshot[applied={T|T < 7333118228987887616}]
I20260925 04:54:27.670363 10032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.670562 10032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.674494 10049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.674751 10049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:27.675076 10049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.675280 10049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:27.675788 10014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:27.676017 10014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:27.681764 10051 catalog_manager.cc:1347] Generated new cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:27.681864 10051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:27.716176 10051 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 04:54:27.718880 10051 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:27.741430 10051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Generated new TSK 0
I20260925 04:54:27.742570 10051 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:27.743877 10051 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:27.748749 10051 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260925 04:54:27.775452 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.81.129:0
--local_ip_for_outbound_sockets=127.9.81.129
--webserver_interface=127.9.81.129
--webserver_port=0
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260925 04:54:28.139675 10061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:28.140002 10061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:28.140163 10061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:28.148983 10061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:28.149278 10061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.81.129
I20260925 04:54:28.157943 10061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.81.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.81.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.81.129
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:28.159158 10061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:28.160800 10061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:28.173862 10069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:28.174021 10066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:28.174048 10067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:28.174554 10061 server_base.cc:1034] running on GCE node
I20260925 04:54:28.175076 10061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:28.175908 10061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:28.177119 10061 hybrid_clock.cc:648] HybridClock initialized: now 1790312068177034 us; error 51 us; skew 500 ppm
I20260925 04:54:28.177416 10061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:28.179615 10061 webserver.cc:460] Webserver started at http://127.9.81.129:36413/ using document root <none> and password file <none>
I20260925 04:54:28.180290 10061 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:28.180457 10061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:28.180838 10061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:28.183765 10061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data/instance:
uuid: "270ea27d66a1425eae85f73563e04c00"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.184521 10061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/instance:
uuid: "270ea27d66a1425eae85f73563e04c00"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.190142 10061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260925 04:54:28.193589 10075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.194916 10061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260925 04:54:28.195076 10061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal
uuid: "270ea27d66a1425eae85f73563e04c00"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.195281 10061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:28.213617 10061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:28.214582 10061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:28.215014 10061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:28.216058 10061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 04:54:28.217981 10061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 04:54:28.218070 10061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.218187 10061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 04:54:28.218246 10061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.252462 10105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:28.253633 10105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:28.257391 10105 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:28.261160 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:28.262765 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:28.263903 9869 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:28.264397 10105 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:28.283823 10061 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.129:36933
I20260925 04:54:28.283881 10188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.129:36933 every 8 connection(s)
I20260925 04:54:28.285353 10061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/data/info.pb
I20260925 04:54:28.289343 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 10061
I20260925 04:54:28.289566 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/instance
I20260925 04:54:28.295159 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.81.130:0
--local_ip_for_outbound_sockets=127.9.81.130
--webserver_interface=127.9.81.130
--webserver_port=0
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260925 04:54:28.314762 10029 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:28.314884 10029 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: loading cluster ID for follower catalog manager: success
I20260925 04:54:28.318617 10029 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: acquiring CA information for follower catalog manager: success
I20260925 04:54:28.320454 10029 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:28.328564 10190 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:28.328960 10190 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.330076 10190 heartbeater.cc:511] Master 127.9.81.190:37617 requested a full tablet report, sending...
I20260925 04:54:28.332471 9813 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:28.334182 10191 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:28.334342 10191 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.334689 10191 heartbeater.cc:511] Master 127.9.81.189:45475 requested a full tablet report, sending...
I20260925 04:54:28.336036 9883 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:28.338269 10189 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:28.338403 10189 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.338760 10189 heartbeater.cc:511] Master 127.9.81.188:40705 requested a full tablet report, sending...
I20260925 04:54:28.339982 9953 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:28.341449 9953 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.81.129:47033
I20260925 04:54:28.500926 10047 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:28.501066 10047 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: success
I20260925 04:54:28.503474 10047 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: acquiring CA information for follower catalog manager: success
I20260925 04:54:28.505126 10047 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260925 04:54:28.670527 10196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:28.670799 10196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:28.670984 10196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:28.678856 10196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:28.679097 10196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.81.130
I20260925 04:54:28.689673 10196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.81.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.81.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.81.130
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:28.690920 10196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:28.692849 10196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:28.706274 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:28.707372 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:28.708360 10204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:28.710400 10196 server_base.cc:1034] running on GCE node
I20260925 04:54:28.711028 10196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:28.713217 10196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:28.714437 10196 hybrid_clock.cc:648] HybridClock initialized: now 1790312068714371 us; error 43 us; skew 500 ppm
I20260925 04:54:28.714733 10196 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:28.715286 10210 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:28.715516 10210 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:28.717535 10210 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:28.717633 10196 webserver.cc:460] Webserver started at http://127.9.81.130:39165/ using document root <none> and password file <none>
I20260925 04:54:28.717512 9892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:28.717653 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:28.718274 9799 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:28.718497 10196 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:28.718621 10210 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:28.718784 10196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:28.719135 10196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:28.722385 10196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data/instance:
uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.723241 10196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/instance:
uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.729216 10196 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260925 04:54:28.732303 10214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.733652 10196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:28.733830 10196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal
uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
format_stamp: "Formatted at 2026-09-25 04:54:28 on dist-test-slave-qkh6"
I20260925 04:54:28.734004 10196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:28.747027 10196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:28.747766 10196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:28.748057 10196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:28.748914 10196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 04:54:28.750692 10196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 04:54:28.750802 10196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.750948 10196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 04:54:28.751019 10196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:28.785789 10196 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.130:33869
I20260925 04:54:28.785877 10326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.130:33869 every 8 connection(s)
I20260925 04:54:28.787067 10196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/data/info.pb
I20260925 04:54:28.790819 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 10196
I20260925 04:54:28.791040 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/instance
I20260925 04:54:28.799212 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.81.131:0
--local_ip_for_outbound_sockets=127.9.81.131
--webserver_interface=127.9.81.131
--webserver_port=0
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260925 04:54:28.808280 10328 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:28.808341 10327 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:28.808633 10328 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.808630 10327 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.809650 10327 heartbeater.cc:511] Master 127.9.81.188:40705 requested a full tablet report, sending...
I20260925 04:54:28.810585 10328 heartbeater.cc:511] Master 127.9.81.190:37617 requested a full tablet report, sending...
I20260925 04:54:28.812126 9813 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:28.812626 9953 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:28.813721 9953 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.81.130:55885
I20260925 04:54:28.816928 10329 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:28.817096 10329 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:28.817440 10329 heartbeater.cc:511] Master 127.9.81.189:45475 requested a full tablet report, sending...
I20260925 04:54:28.818498 9883 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:28.833381 10335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:28.833554 10335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:28.834185 10335 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:28.834645 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:28.834826 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:28.835362 9870 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:28.835626 10335 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:28.844238 10189 heartbeater.cc:503] Master 127.9.81.188:40705 was elected leader, sending a full tablet report...
W20260925 04:54:29.145392 10334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:29.145695 10334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:29.145867 10334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:29.152858 10334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:29.153121 10334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.81.131
I20260925 04:54:29.162307 10334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.81.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.81.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.81.131
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:29.163547 10334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:29.165239 10334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:29.178248 10340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:29.178308 10341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:29.178320 10343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:29.179644 10334 server_base.cc:1034] running on GCE node
I20260925 04:54:29.180263 10334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:29.181187 10334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:29.182412 10334 hybrid_clock.cc:648] HybridClock initialized: now 1790312069182336 us; error 56 us; skew 500 ppm
I20260925 04:54:29.182691 10334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:29.184755 10334 webserver.cc:460] Webserver started at http://127.9.81.131:39961/ using document root <none> and password file <none>
I20260925 04:54:29.185451 10334 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:29.185597 10334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:29.185894 10334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 04:54:29.188390 10334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data/instance:
uuid: "604491977af14bc2b62f45a594c13bf9"
format_stamp: "Formatted at 2026-09-25 04:54:29 on dist-test-slave-qkh6"
I20260925 04:54:29.189188 10334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/instance:
uuid: "604491977af14bc2b62f45a594c13bf9"
format_stamp: "Formatted at 2026-09-25 04:54:29 on dist-test-slave-qkh6"
I20260925 04:54:29.194294 10334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260925 04:54:29.197981 10349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:29.199273 10334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260925 04:54:29.199441 10334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal
uuid: "604491977af14bc2b62f45a594c13bf9"
format_stamp: "Formatted at 2026-09-25 04:54:29 on dist-test-slave-qkh6"
I20260925 04:54:29.199621 10334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:29.217609 10334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:29.218382 10334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:29.218672 10334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:29.219551 10334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 04:54:29.220901 10334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 04:54:29.221000 10334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:29.221167 10334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 04:54:29.221238 10334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:29.258899 10334 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.131:37105
I20260925 04:54:29.258958 10461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.131:37105 every 8 connection(s)
I20260925 04:54:29.260186 10334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/data/info.pb
I20260925 04:54:29.269392 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 10334
I20260925 04:54:29.269590 9542 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/instance
I20260925 04:54:29.279239 10463 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:29.279603 10463 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:29.280616 10463 heartbeater.cc:511] Master 127.9.81.190:37617 requested a full tablet report, sending...
I20260925 04:54:29.282366 9813 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:29.283934 10462 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:29.284060 10462 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:29.284438 10462 heartbeater.cc:511] Master 127.9.81.188:40705 requested a full tablet report, sending...
I20260925 04:54:29.285349 9953 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:29.286691 9953 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.81.131:41397
I20260925 04:54:29.290385 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:29.290524 10464 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:29.290902 10464 heartbeater.cc:511] Master 127.9.81.189:45475 requested a full tablet report, sending...
I20260925 04:54:29.291836 9883 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:29.298061 9542 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260925 04:54:29.316274 10327 heartbeater.cc:503] Master 127.9.81.188:40705 was elected leader, sending a full tablet report...
I20260925 04:54:29.335666 9953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_c4023953be09425f877d1e8a30f45361"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.338444 9952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_7c18ad193ee94ec4b84052d29519acd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.339323 9948 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_80d05ca86f934088be48a6989b971ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.339963 9951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_273e0dfb03e648e4b9fd3a8abf07a709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.340421 9949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_946f8d86c819438fbca12b46346be9a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.341521 9950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_e28617bb40fa4c7fac94b5a3467e7570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.342794 9947 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_8e8ca768548d4f2887c17d8046fe4c32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 04:54:29.345920 9953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c4023953be09425f877d1e8a30f45361 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:29.345783 9946 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_7f50ccca03c042aeb74dd26f1ca15658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.350551 9945 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_41a0c852a29745399a4b27608bae6f60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.354493 9944 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_374e8adb8ba2493996c57ce359e519b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:29.370625 9542 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu pid 9849
I20260925 04:54:29.371690 9913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 04:54:29.535636 9542 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu with pid 9849
I20260925 04:54:29.639664 10509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:29.639846 10509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:29.640403 10509 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:29.640930 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
W20260925 04:54:29.642652 9799 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:29.642774 9799 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:29.643044 10509 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:29.789161 10462 heartbeater.cc:503] Master 127.9.81.188:40705 was elected leader, sending a full tablet report...
W20260925 04:54:29.793637 10464 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:29.822016 10329 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:29.846390 10191 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:29.859899 9939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:29.861276 9939 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc -> Peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Couldn't send request to peer 9c78f840b646474a98deff6bac54d5cc. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:30.146864 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--webserver_interface=127.9.81.189
--webserver_port=36963
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:30.177538 10518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:30.177740 10518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:30.178517 10518 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:30.179941 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
W20260925 04:54:30.182119 9799 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:30.182245 9799 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:30.182480 10518 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:30.335728 9953 catalog_manager.cc:2148] created HMS catalog entry for table [id=7911f32186554f5784504181f296bb04]
W20260925 04:54:30.338809 9952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7c18ad193ee94ec4b84052d29519acd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.340039 9947 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8e8ca768548d4f2887c17d8046fe4c32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.341033 9950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e28617bb40fa4c7fac94b5a3467e7570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.341976 9949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_946f8d86c819438fbca12b46346be9a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.343058 9951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_273e0dfb03e648e4b9fd3a8abf07a709 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.344214 9948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_80d05ca86f934088be48a6989b971ac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:30.369601 9953 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 1) took 1034 ms. Trace:
I20260925 04:54:30.369789 9953 rpcz_store.cc:276] 0925 04:54:29.334646 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.334886 (+ 240us) service_pool.cc:227] Handling call
0925 04:54:29.346169 (+ 11283us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:29.347431 (+ 1262us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:30.335667 (+988236us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:30.368748 (+ 33081us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:30.369247 (+ 499us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:30.369551 (+ 304us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:30.338476 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:30.338643 (+ 167us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:30.338649 (+ 6us) write_op.cc:435] Acquired schema lock
0925 04:54:30.338651 (+ 2us) tablet.cc:660] Decoding operations
0925 04:54:30.338780 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:30.338801 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:30.338805 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:30.338956 (+ 151us) tablet.cc:699] Row locks acquired
0925 04:54:30.338960 (+ 4us) write_op.cc:260] PREPARE: finished
0925 04:54:30.339002 (+ 42us) write_op.cc:270] Start()
0925 04:54:30.339042 (+ 40us) write_op.cc:276] Timestamp: P: 1790312070338962 usec, L: 0
0925 04:54:30.339044 (+ 2us) op_driver.cc:331] REPLICATION: starting
0925 04:54:30.339219 (+ 175us) log.cc:842] Serialized 432 byte log entry
0925 04:54:30.359185 (+ 19966us) op_driver.cc:444] REPLICATION: finished
0925 04:54:30.366042 (+ 6857us) write_op.cc:301] APPLY: starting
0925 04:54:30.366068 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:30.366144 (+ 76us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:30.366189 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:30.366381 (+ 192us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:30.366439 (+ 58us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:30.366449 (+ 10us) write_op.cc:312] APPLY: finished
0925 04:54:30.366580 (+ 131us) log.cc:842] Serialized 28 byte log entry
0925 04:54:30.366690 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:30.366717 (+ 27us) write_op.cc:454] Released schema lock
0925 04:54:30.366728 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":1704,"Hive Metastore.run_cpu_time_us":561,"Hive Metastore.run_wall_time_us":986002,"child_traces":[["op",{"apply.queue_time_us":6780,"mutex_wait_us":105,"num_ops":2,"prepare.queue_time_us":1657,"prepare.run_cpu_time_us":1215,"prepare.run_wall_time_us":2263,"raft.queue_time_us":194,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":383,"replication_time_us":20115,"spinlock_wait_cycles":896,"thread_start_us":9320,"threads_started":3,"wal-append.queue_time_us":417}]]}
I20260925 04:54:30.380738 10530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:30.382027 10530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:30.388733 9953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_c4023953be09425f877d1e8a30f45361" } new_table_name: "default.Table_48a023979ead4432a298d53c804329da" modify_external_catalogs: true
W20260925 04:54:30.394613 9946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7f50ccca03c042aeb74dd26f1ca15658 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.396054 9944 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_374e8adb8ba2493996c57ce359e519b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:30.397369 9945 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_41a0c852a29745399a4b27608bae6f60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:30.450052 10397 tablet_service.cc:1467] Processing CreateTablet for tablet feb23358e62440d9a35a735fa026b836 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.450093 10124 tablet_service.cc:1467] Processing CreateTablet for tablet feb23358e62440d9a35a735fa026b836 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.451530 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feb23358e62440d9a35a735fa026b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.454360 10262 tablet_service.cc:1467] Processing CreateTablet for tablet feb23358e62440d9a35a735fa026b836 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.455572 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feb23358e62440d9a35a735fa026b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.457234 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feb23358e62440d9a35a735fa026b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.476246 10544 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:30.480137 10544 tablet_bootstrap.cc:654] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.485098 10546 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:30.488480 10545 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:30.488837 10546 tablet_bootstrap.cc:654] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.481701 10544 log.cc:824] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:30.490275 10546 log.cc:824] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:30.492769 10545 tablet_bootstrap.cc:654] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.494124 10545 log.cc:824] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:30.502826 10546 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:30.503499 10546 ts_tablet_manager.cc:1397] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.000s
I20260925 04:54:30.515249 10545 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:30.515262 10544 tablet_bootstrap.cc:492] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:30.515538 10545 ts_tablet_manager.cc:1397] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.027s user 0.016s sys 0.008s
I20260925 04:54:30.515552 10544 ts_tablet_manager.cc:1397] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.003s
I20260925 04:54:30.516824 10546 raft_consensus.cc:348] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.517457 10546 raft_consensus.cc:374] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.517622 10546 raft_consensus.cc:729] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.518467 10546 consensus_queue.cc:260] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.528123 10544 raft_consensus.cc:348] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.528630 10544 raft_consensus.cc:374] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.528767 10544 raft_consensus.cc:729] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.529520 10544 consensus_queue.cc:260] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.536441 9952 catalog_manager.cc:2148] created HMS catalog entry for table [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:30.538115 10546 ts_tablet_manager.cc:1428] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.034s user 0.013s sys 0.007s
I20260925 04:54:30.544950 9952 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 2) took 1210 ms. Trace:
I20260925 04:54:30.545113 9952 rpcz_store.cc:276] 0925 04:54:29.334829 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.336278 (+ 1449us) service_pool.cc:227] Handling call
0925 04:54:30.338921 (+1002643us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.339438 (+ 517us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:30.536382 (+196944us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:30.544673 (+ 8291us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:30.544812 (+ 139us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:30.544909 (+ 97us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:30.537356 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:30.537471 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:30.537478 (+ 7us) write_op.cc:435] Acquired schema lock
0925 04:54:30.537480 (+ 2us) tablet.cc:660] Decoding operations
0925 04:54:30.537576 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:30.537591 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:30.537596 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:30.537685 (+ 89us) tablet.cc:699] Row locks acquired
0925 04:54:30.537687 (+ 2us) write_op.cc:260] PREPARE: finished
0925 04:54:30.537726 (+ 39us) write_op.cc:270] Start()
0925 04:54:30.537764 (+ 38us) write_op.cc:276] Timestamp: P: 1790312070537667 usec, L: 0
0925 04:54:30.537767 (+ 3us) op_driver.cc:331] REPLICATION: starting
0925 04:54:30.537974 (+ 207us) log.cc:842] Serialized 432 byte log entry
0925 04:54:30.543366 (+ 5392us) op_driver.cc:444] REPLICATION: finished
0925 04:54:30.543506 (+ 140us) write_op.cc:301] APPLY: starting
0925 04:54:30.543521 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:30.543571 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:30.543630 (+ 59us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:30.543802 (+ 172us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:30.543838 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:30.543846 (+ 8us) write_op.cc:312] APPLY: finished
0925 04:54:30.543931 (+ 85us) log.cc:842] Serialized 28 byte log entry
0925 04:54:30.544005 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:30.544026 (+ 21us) write_op.cc:454] Released schema lock
0925 04:54:30.544033 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:30.544083 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:30.544087 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":7778,"Hive Metastore.run_cpu_time_us":312,"Hive Metastore.run_wall_time_us":188690,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":628,"apply.run_wall_time_us":628,"num_ops":2,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":754,"prepare.run_wall_time_us":754,"raft.queue_time_us":156,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":335,"replication_time_us":5564}]]}
I20260925 04:54:30.552250 10545 raft_consensus.cc:348] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.552800 10545 raft_consensus.cc:374] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.552917 10545 raft_consensus.cc:729] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.553766 10545 consensus_queue.cc:260] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:30.558846 10124 tablet_service.cc:1467] Processing CreateTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.559319 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.561576 10262 tablet_service.cc:1467] Processing CreateTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.562058 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.563443 10545 ts_tablet_manager.cc:1428] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.048s user 0.013s sys 0.004s
I20260925 04:54:30.574862 10545 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:30.576556 10545 tablet_bootstrap.cc:654] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.576573 10397 tablet_service.cc:1467] Processing CreateTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.577010 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.583767 9952 master_service.cc:946] ReplaceTablet: received request to replace tablet feb23358e62440d9a35a735fa026b836 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:30.584647 10546 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:30.586284 10546 tablet_bootstrap.cc:654] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.592249 10544 ts_tablet_manager.cc:1428] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.077s user 0.015s sys 0.005s
I20260925 04:54:30.594157 10544 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:30.596258 10544 tablet_bootstrap.cc:654] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.598274 10545 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:30.598467 10545 ts_tablet_manager.cc:1397] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.001s
I20260925 04:54:30.599874 10545 raft_consensus.cc:348] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.600271 10545 raft_consensus.cc:374] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.600399 10545 raft_consensus.cc:729] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.600732 10545 consensus_queue.cc:260] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.601562 10545 ts_tablet_manager.cc:1428] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:30.603019 10546 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:30.603250 10546 ts_tablet_manager.cc:1397] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.003s
I20260925 04:54:30.604246 10546 raft_consensus.cc:348] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.604539 10546 raft_consensus.cc:374] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.604691 10546 raft_consensus.cc:729] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.605080 10546 consensus_queue.cc:260] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.606839 9952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Sending DeleteTablet for 3 replicas of tablet feb23358e62440d9a35a735fa026b836
I20260925 04:54:30.607932 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet feb23358e62440d9a35a735fa026b836 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d4b6c4952014527bf94de01bc05571f) from {username='slave'} at 127.0.0.1:57708
I20260925 04:54:30.608333 10544 tablet_bootstrap.cc:492] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:30.608490 10544 ts_tablet_manager.cc:1397] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
I20260925 04:54:30.608526 10546 ts_tablet_manager.cc:1428] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260925 04:54:30.609457 10544 raft_consensus.cc:348] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.609679 10544 raft_consensus.cc:374] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.609786 10544 raft_consensus.cc:729] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.610038 10544 consensus_queue.cc:260] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.610669 10544 ts_tablet_manager.cc:1428] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:30.612571 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet feb23358e62440d9a35a735fa026b836 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d4b6c4952014527bf94de01bc05571f) from {username='slave'} at 127.0.0.1:48866
I20260925 04:54:30.613879 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet feb23358e62440d9a35a735fa026b836 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d4b6c4952014527bf94de01bc05571f) from {username='slave'} at 127.0.0.1:59588
I20260925 04:54:30.616920 9952 catalog_manager.cc:6565] ReplaceTablet: tablet feb23358e62440d9a35a735fa026b836 deleted and replaced by tablet 2d4b6c4952014527bf94de01bc05571f
I20260925 04:54:30.626780 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4b6c4952014527bf94de01bc05571f (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.626842 10123 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4b6c4952014527bf94de01bc05571f (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.627307 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4b6c4952014527bf94de01bc05571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.627341 10123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4b6c4952014527bf94de01bc05571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.629201 9952 master_service.cc:946] ReplaceTablet: received request to replace tablet feb23358e62440d9a35a735fa026b836 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:30.630257 9952 master_service.cc:946] ReplaceTablet: received request to replace tablet feb23358e62440d9a35a735fa026b836 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:30.631472 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4b6c4952014527bf94de01bc05571f (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.631830 9952 master_service.cc:946] ReplaceTablet: received request to replace tablet feb23358e62440d9a35a735fa026b836 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:30.631980 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4b6c4952014527bf94de01bc05571f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.632542 9952 master_service.cc:946] ReplaceTablet: received request to replace tablet feb23358e62440d9a35a735fa026b836 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:30.633392 9952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_7c18ad193ee94ec4b84052d29519acd5" } new_table_name: "default.Table_046291a687f44532af93aec0cf2df2c4" modify_external_catalogs: true
I20260925 04:54:30.634245 10556 tablet_replica.cc:330] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:30.634734 10556 raft_consensus.cc:2229] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:30.635195 10556 raft_consensus.cc:2258] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:30.638386 10544 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:30.639583 10556 ts_tablet_manager.cc:1905] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:30.640519 10544 tablet_bootstrap.cc:654] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.651163 10557 tablet_replica.cc:330] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:30.651403 10558 tablet_replica.cc:330] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:30.651815 10557 raft_consensus.cc:2229] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:30.651853 10558 raft_consensus.cc:2229] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:30.651983 10544 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:30.652197 10544 ts_tablet_manager.cc:1397] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260925 04:54:30.652318 10557 raft_consensus.cc:2258] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:30.652356 10558 raft_consensus.cc:2258] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:30.653080 10544 raft_consensus.cc:348] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.653507 10544 raft_consensus.cc:374] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.653635 10544 raft_consensus.cc:729] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.653736 10545 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:30.654022 10544 consensus_queue.cc:260] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.654167 10546 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:30.654791 10544 ts_tablet_manager.cc:1428] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:30.655392 10545 tablet_bootstrap.cc:654] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.655807 10546 tablet_bootstrap.cc:654] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.657387 10545 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:30.657585 10545 ts_tablet_manager.cc:1397] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260925 04:54:30.658010 10558 ts_tablet_manager.cc:1905] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:30.658437 10545 raft_consensus.cc:348] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.658785 10545 raft_consensus.cc:374] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.658912 10545 raft_consensus.cc:729] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.659272 10545 consensus_queue.cc:260] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.660072 10557 ts_tablet_manager.cc:1905] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:30.661922 10545 ts_tablet_manager.cc:1428] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 04:54:30.664170 10546 tablet_bootstrap.cc:492] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:30.664356 10546 ts_tablet_manager.cc:1397] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20260925 04:54:30.665063 10546 raft_consensus.cc:348] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.665302 10546 raft_consensus.cc:374] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.665377 10546 raft_consensus.cc:729] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.665659 10546 consensus_queue.cc:260] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.668413 10546 ts_tablet_manager.cc:1428] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
W20260925 04:54:30.673976 10517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:30.674284 10517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:30.674431 10517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:30.682191 10517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:30.682322 10517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:30.682407 10517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:30.682503 10517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:30.692067 10517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.81.189
--webserver_port=36963
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:30.693455 10517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:30.695147 10517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260925 04:54:30.697109 10552 raft_consensus.cc:482] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:30.697409 10552 raft_consensus.cc:504] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.699486 10552 leader_election.cc:288] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
W20260925 04:54:30.709543 10567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:30.709522 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dbd8c5232c4c28a1b37b31ae7c03f4" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:30.710048 10417 raft_consensus.cc:2454] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:30.710629 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dbd8c5232c4c28a1b37b31ae7c03f4" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:30.710819 10217 leader_election.cc:302] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:30.711233 10144 raft_consensus.cc:2454] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:30.712431 10552 raft_consensus.cc:2781] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:30.712636 10552 raft_consensus.cc:482] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:30.712757 10552 raft_consensus.cc:3037] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
W20260925 04:54:30.713426 10568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:30.714959 10570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:30.715761 10517 server_base.cc:1034] running on GCE node
I20260925 04:54:30.716502 10517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:30.717926 10517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:30.719162 10517 hybrid_clock.cc:648] HybridClock initialized: now 1790312070719103 us; error 33 us; skew 500 ppm
I20260925 04:54:30.719496 10517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:30.721812 10517 webserver.cc:460] Webserver started at http://127.9.81.189:36963/ using document root <none> and password file <none>
I20260925 04:54:30.722472 10517 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:30.722625 10517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:30.727540 10517 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260925 04:54:30.730322 10576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:30.731730 10517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:30.731945 10517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:30.732945 10517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:30.746954 10558 ts_tablet_manager.cc:1918] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:30.747110 10558 log.cc:1196] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/feb23358e62440d9a35a735fa026b836
I20260925 04:54:30.747495 10558 ts_tablet_manager.cc:1939] T feb23358e62440d9a35a735fa026b836 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:30.747632 10556 ts_tablet_manager.cc:1918] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:30.747795 10556 log.cc:1196] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/feb23358e62440d9a35a735fa026b836
I20260925 04:54:30.747885 10552 raft_consensus.cc:504] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.748198 10556 ts_tablet_manager.cc:1939] T feb23358e62440d9a35a735fa026b836 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:30.748525 10552 leader_election.cc:288] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:30.749238 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dbd8c5232c4c28a1b37b31ae7c03f4" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:30.749250 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dbd8c5232c4c28a1b37b31ae7c03f4" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:30.749437 10144 raft_consensus.cc:3037] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:30.749460 10417 raft_consensus.cc:3037] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:30.766450 10517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:30.767254 10517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:30.767488 10517 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260925 04:54:30.769412 10465 tablet.cc:2369] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 04:54:30.787774 10517 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.189:45475
I20260925 04:54:30.787748 10627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.189:45475 every 8 connection(s)
I20260925 04:54:30.789376 10517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
W20260925 04:54:30.790932 10330 tablet.cc:2369] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 04:54:30.793171 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 10517
I20260925 04:54:30.798159 10628 sys_catalog.cc:263] Verifying existing consensus state
W20260925 04:54:30.800709 10192 tablet.cc:2369] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 04:54:30.803026 10628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap starting.
I20260925 04:54:30.811532 9940 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet feb23358e62440d9a35a735fa026b836 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:30.811538 10628 log.cc:824] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:30.812444 9938 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet feb23358e62440d9a35a735fa026b836 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:30.819073 10628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 04:54:30.819561 10628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap complete.
I20260925 04:54:30.826754 10628 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:30.827625 10628 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.828223 10628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:30.828930 10632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:30.829329 10632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:30.830049 10628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:30.836043 10417 raft_consensus.cc:2454] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:30.836063 10144 raft_consensus.cc:2454] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:30.836596 10218 leader_election.cc:302] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:30.837092 10552 raft_consensus.cc:2781] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:30.837600 10552 raft_consensus.cc:686] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:30.838001 10552 consensus_queue.cc:237] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.850140 9947 catalog_manager.cc:2148] created HMS catalog entry for table [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:30.852880 10557 ts_tablet_manager.cc:1918] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:30.853142 10557 log.cc:1196] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/feb23358e62440d9a35a735fa026b836
I20260925 04:54:30.853729 10557 ts_tablet_manager.cc:1939] T feb23358e62440d9a35a735fa026b836 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:30.858353 9947 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 7) took 1515 ms. Trace:
I20260925 04:54:30.858516 9947 rpcz_store.cc:276] 0925 04:54:29.342401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.342468 (+ 67us) service_pool.cc:227] Handling call
0925 04:54:30.340154 (+997686us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.340640 (+ 486us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:30.850075 (+509435us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:30.858012 (+ 7937us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:30.858176 (+ 164us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:30.858293 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:30.851384 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:30.851535 (+ 151us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:30.851544 (+ 9us) write_op.cc:435] Acquired schema lock
0925 04:54:30.851548 (+ 4us) tablet.cc:660] Decoding operations
0925 04:54:30.851674 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:30.851694 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:30.851702 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:30.851812 (+ 110us) tablet.cc:699] Row locks acquired
0925 04:54:30.851816 (+ 4us) write_op.cc:260] PREPARE: finished
0925 04:54:30.851858 (+ 42us) write_op.cc:270] Start()
0925 04:54:30.851904 (+ 46us) write_op.cc:276] Timestamp: P: 1790312070851820 usec, L: 0
0925 04:54:30.851910 (+ 6us) op_driver.cc:331] REPLICATION: starting
0925 04:54:30.852136 (+ 226us) log.cc:842] Serialized 432 byte log entry
0925 04:54:30.856409 (+ 4273us) op_driver.cc:444] REPLICATION: finished
0925 04:54:30.856588 (+ 179us) write_op.cc:301] APPLY: starting
0925 04:54:30.856606 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:30.856674 (+ 68us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:30.856717 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:30.856846 (+ 129us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:30.856898 (+ 52us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:30.856909 (+ 11us) write_op.cc:312] APPLY: finished
0925 04:54:30.857025 (+ 116us) log.cc:842] Serialized 28 byte log entry
0925 04:54:30.857096 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:30.857122 (+ 26us) write_op.cc:454] Released schema lock
0925 04:54:30.857131 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:30.857198 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:30.857205 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":195377,"Hive Metastore.run_cpu_time_us":295,"Hive Metastore.run_wall_time_us":313621,"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":676,"apply.run_wall_time_us":675,"num_ops":2,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":885,"prepare.run_wall_time_us":885,"raft.queue_time_us":1075,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":286,"replication_time_us":4468}]]}
I20260925 04:54:30.869498 10551 raft_consensus.cc:482] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:30.869714 10551 raft_consensus.cc:504] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.871419 10551 leader_election.cc:288] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:30.882064 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 4e7f407cf2bc44838b85ebd44955acef (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.882210 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 4e7f407cf2bc44838b85ebd44955acef (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.882627 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e7f407cf2bc44838b85ebd44955acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.882632 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e7f407cf2bc44838b85ebd44955acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.891139 10545 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:30.892740 10545 tablet_bootstrap.cc:654] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.893910 10123 tablet_service.cc:1467] Processing CreateTablet for tablet 4e7f407cf2bc44838b85ebd44955acef (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:30.894292 10123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e7f407cf2bc44838b85ebd44955acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:30.897042 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d4b6c4952014527bf94de01bc05571f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:30.897460 10282 raft_consensus.cc:2454] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:30.898463 10077 leader_election.cc:302] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:30.898978 10551 raft_consensus.cc:2781] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:30.899096 10551 raft_consensus.cc:482] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:30.899176 10551 raft_consensus.cc:3037] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:30.904225 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d4b6c4952014527bf94de01bc05571f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:30.904505 10417 raft_consensus.cc:2454] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:30.914559 10546 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:30.915702 9947 catalog_manager.cc:5495] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130). New cstate: current_term: 1 leader_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:30.916903 10546 tablet_bootstrap.cc:654] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.933195 9947 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_9a7f064f807444c69ef2ae958de42e7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:30.937363 10545 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:30.937654 10545 ts_tablet_manager.cc:1397] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.007s
I20260925 04:54:30.938560 10545 raft_consensus.cc:348] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.938938 10545 raft_consensus.cc:374] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.939069 10545 raft_consensus.cc:729] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.939265 10546 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:30.939458 10546 ts_tablet_manager.cc:1397] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.001s
I20260925 04:54:30.939427 10545 consensus_queue.cc:260] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.940454 10546 raft_consensus.cc:348] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.940768 10546 raft_consensus.cc:374] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.940896 10546 raft_consensus.cc:729] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.941226 10545 ts_tablet_manager.cc:1428] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:30.941231 10546 consensus_queue.cc:260] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.942030 10649 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:30.942165 10649 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: success
I20260925 04:54:30.947414 10649 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: acquiring CA information for follower catalog manager: success
I20260925 04:54:30.951257 10551 raft_consensus.cc:504] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.952067 10551 leader_election.cc:288] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:30.954083 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d4b6c4952014527bf94de01bc05571f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:30.954137 9939 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet feb23358e62440d9a35a735fa026b836 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:30.954324 10417 raft_consensus.cc:3037] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:30.954531 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d4b6c4952014527bf94de01bc05571f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:30.954744 10282 raft_consensus.cc:3037] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:30.958397 10649 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:30.960683 10329 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:30.960907 10544 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:30.963013 10544 tablet_bootstrap.cc:654] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:30.968921 10546 ts_tablet_manager.cc:1428] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260925 04:54:30.971441 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:30.991114 10544 tablet_bootstrap.cc:492] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:30.992014 10544 ts_tablet_manager.cc:1397] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.004s
I20260925 04:54:30.992830 10544 raft_consensus.cc:348] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.993120 10544 raft_consensus.cc:374] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:30.993216 10544 raft_consensus.cc:729] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:30.995069 10544 consensus_queue.cc:260] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:30.995714 10544 ts_tablet_manager.cc:1428] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 04:54:31.008541 10191 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:31.010576 10632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:31.010928 10632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:31.012945 10592 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:50027; Asking this server to re-register.
I20260925 04:54:31.013931 10530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:31.014302 10530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:31.017033 10191 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:31.019490 10592 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:31.026580 10550 raft_consensus.cc:482] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:31.026837 10550 raft_consensus.cc:504] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.029518 10550 leader_election.cc:288] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:31.040161 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e7f407cf2bc44838b85ebd44955acef" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:31.040526 10281 raft_consensus.cc:2454] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:31.041117 10351 leader_election.cc:302] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.041636 10550 raft_consensus.cc:2781] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:31.041795 10550 raft_consensus.cc:482] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:31.041941 10550 raft_consensus.cc:3037] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.045922 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e7f407cf2bc44838b85ebd44955acef" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:31.046190 10144 raft_consensus.cc:2454] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:31.047571 10417 raft_consensus.cc:2454] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.047590 10282 raft_consensus.cc:2454] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.048095 10077 leader_election.cc:302] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.048394 10551 raft_consensus.cc:2781] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:31.050173 10592 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:35701; Asking this server to re-register.
I20260925 04:54:31.050164 10550 raft_consensus.cc:504] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.050844 10464 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:31.051378 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e7f407cf2bc44838b85ebd44955acef" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:31.051622 10282 raft_consensus.cc:3037] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.052125 10592 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.054293 10282 raft_consensus.cc:2454] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:31.054680 10351 leader_election.cc:302] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.056298 10550 leader_election.cc:288] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:31.056638 10550 raft_consensus.cc:2781] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:31.056977 10550 raft_consensus.cc:686] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:31.057595 10550 consensus_queue.cc:237] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.059252 10592 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:60153; Asking this server to re-register.
I20260925 04:54:31.060240 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e7f407cf2bc44838b85ebd44955acef" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:31.060534 10144 raft_consensus.cc:3037] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.064651 10329 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:31.066130 10592 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:31.070182 10551 raft_consensus.cc:686] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:31.070582 10551 consensus_queue.cc:237] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.151062 10144 raft_consensus.cc:2454] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:31.160123 9950 catalog_manager.cc:2148] created HMS catalog entry for table [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:31.166867 9950 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 4) took 1831 ms. Trace:
I20260925 04:54:31.167014 9950 rpcz_store.cc:276] 0925 04:54:29.335810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.336348 (+ 538us) service_pool.cc:227] Handling call
0925 04:54:30.341139 (+1004791us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.341566 (+ 427us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:31.160066 (+818500us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:31.166585 (+ 6519us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:31.166700 (+ 115us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:31.166810 (+ 110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:31.160921 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:31.161085 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:31.161091 (+ 6us) write_op.cc:435] Acquired schema lock
0925 04:54:31.161093 (+ 2us) tablet.cc:660] Decoding operations
0925 04:54:31.161193 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:31.161208 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:31.161213 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:31.161312 (+ 99us) tablet.cc:699] Row locks acquired
0925 04:54:31.161315 (+ 3us) write_op.cc:260] PREPARE: finished
0925 04:54:31.161352 (+ 37us) write_op.cc:270] Start()
0925 04:54:31.161404 (+ 52us) write_op.cc:276] Timestamp: P: 1790312071161285 usec, L: 0
0925 04:54:31.161408 (+ 4us) op_driver.cc:331] REPLICATION: starting
0925 04:54:31.161616 (+ 208us) log.cc:842] Serialized 432 byte log entry
0925 04:54:31.166010 (+ 4394us) op_driver.cc:444] REPLICATION: finished
0925 04:54:31.166119 (+ 109us) write_op.cc:301] APPLY: starting
0925 04:54:31.166132 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:31.166175 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:31.166207 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:31.166310 (+ 103us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:31.166343 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:31.166349 (+ 6us) write_op.cc:312] APPLY: finished
0925 04:54:31.166420 (+ 71us) log.cc:842] Serialized 28 byte log entry
0925 04:54:31.166476 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:31.166494 (+ 18us) write_op.cc:454] Released schema lock
0925 04:54:31.166501 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:31.166554 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:31.166557 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":508149,"Hive Metastore.run_cpu_time_us":330,"Hive Metastore.run_wall_time_us":310149,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":481,"apply.run_wall_time_us":480,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":824,"prepare.run_wall_time_us":832,"raft.queue_time_us":437,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":502,"replication_time_us":4581}]]}
I20260925 04:54:31.177044 10123 tablet_service.cc:1467] Processing CreateTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.177476 10123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d712e2b2c89468c9d0aa4453bcfa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.178380 9950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:31.180290 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.180677 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d712e2b2c89468c9d0aa4453bcfa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.182314 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.182746 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d712e2b2c89468c9d0aa4453bcfa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.188088 10546 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:31.189642 10546 tablet_bootstrap.cc:654] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.190640 10545 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:31.192579 10545 tablet_bootstrap.cc:654] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.193169 10544 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:31.194641 10544 tablet_bootstrap.cc:654] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.200671 10544 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:31.200953 10544 ts_tablet_manager.cc:1397] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.001s
I20260925 04:54:31.201939 10544 raft_consensus.cc:348] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.202330 10544 raft_consensus.cc:374] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.202471 10544 raft_consensus.cc:729] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.202836 10544 consensus_queue.cc:260] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.203603 10544 ts_tablet_manager.cc:1428] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:31.216152 10546 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:31.216406 10546 ts_tablet_manager.cc:1397] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.002s
I20260925 04:54:31.217274 10546 raft_consensus.cc:348] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.218029 10546 raft_consensus.cc:374] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.218156 10546 raft_consensus.cc:729] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.218469 10546 consensus_queue.cc:260] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.218595 10545 tablet_bootstrap.cc:492] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:31.218762 10545 ts_tablet_manager.cc:1397] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.005s
I20260925 04:54:31.219115 10546 ts_tablet_manager.cc:1428] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:31.220008 10545 raft_consensus.cc:348] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.220323 10545 raft_consensus.cc:374] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.220456 10545 raft_consensus.cc:729] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.220757 10545 consensus_queue.cc:260] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.221510 10545 ts_tablet_manager.cc:1428] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:31.358354 9949 catalog_manager.cc:2148] created HMS catalog entry for table [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:31.366220 9949 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 5) took 2030 ms. Trace:
I20260925 04:54:31.366441 9949 rpcz_store.cc:276] 0925 04:54:29.336222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.336782 (+ 560us) service_pool.cc:227] Handling call
0925 04:54:30.342072 (+1005290us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.342568 (+ 496us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:31.358277 (+1015709us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:31.365944 (+ 7667us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:31.366055 (+ 111us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:31.366166 (+ 111us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:31.359243 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:31.359388 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:31.359395 (+ 7us) write_op.cc:435] Acquired schema lock
0925 04:54:31.359398 (+ 3us) tablet.cc:660] Decoding operations
0925 04:54:31.359498 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:31.359513 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:31.359518 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:31.359632 (+ 114us) tablet.cc:699] Row locks acquired
0925 04:54:31.359634 (+ 2us) write_op.cc:260] PREPARE: finished
0925 04:54:31.359676 (+ 42us) write_op.cc:270] Start()
0925 04:54:31.359714 (+ 38us) write_op.cc:276] Timestamp: P: 1790312071359638 usec, L: 0
0925 04:54:31.359718 (+ 4us) op_driver.cc:331] REPLICATION: starting
0925 04:54:31.359923 (+ 205us) log.cc:842] Serialized 432 byte log entry
0925 04:54:31.364456 (+ 4533us) op_driver.cc:444] REPLICATION: finished
0925 04:54:31.364564 (+ 108us) write_op.cc:301] APPLY: starting
0925 04:54:31.364578 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:31.364622 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:31.364654 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:31.364845 (+ 191us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:31.364881 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:31.364889 (+ 8us) write_op.cc:312] APPLY: finished
0925 04:54:31.364965 (+ 76us) log.cc:842] Serialized 28 byte log entry
0925 04:54:31.365051 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:31.365070 (+ 19us) write_op.cc:454] Released schema lock
0925 04:54:31.365077 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:31.365126 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:31.365130 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":817315,"Hive Metastore.run_cpu_time_us":281,"Hive Metastore.run_wall_time_us":198180,"child_traces":[["op",{"apply.queue_time_us":67,"apply.run_cpu_time_us":611,"apply.run_wall_time_us":610,"num_ops":2,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":805,"prepare.run_wall_time_us":804,"raft.queue_time_us":1355,"raft.run_cpu_time_us":557,"raft.run_wall_time_us":767,"replication_time_us":4715}]]}
I20260925 04:54:31.375478 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.375478 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.375617 10123 tablet_service.cc:1467] Processing CreateTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.375916 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54118ca3f7364c60b5cda9a1983cd640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.375916 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54118ca3f7364c60b5cda9a1983cd640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.376034 10123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54118ca3f7364c60b5cda9a1983cd640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.381846 9949 catalog_manager.cc:5495] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 270ea27d66a1425eae85f73563e04c00 (127.9.81.129). New cstate: current_term: 1 leader_uuid: "270ea27d66a1425eae85f73563e04c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:31.383582 10544 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:31.385278 10544 tablet_bootstrap.cc:654] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.387233 10545 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:31.389391 10545 tablet_bootstrap.cc:654] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.392735 9949 catalog_manager.cc:5495] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 604491977af14bc2b62f45a594c13bf9 (127.9.81.131). New cstate: current_term: 1 leader_uuid: "604491977af14bc2b62f45a594c13bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: HEALTHY } } }
I20260925 04:54:31.401933 10545 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:31.402088 10545 ts_tablet_manager.cc:1397] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20260925 04:54:31.402848 10545 raft_consensus.cc:348] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.403076 10545 raft_consensus.cc:374] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.403159 10545 raft_consensus.cc:729] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.403401 10545 consensus_queue.cc:260] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.406777 10546 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:31.407290 10545 ts_tablet_manager.cc:1428] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 04:54:31.409091 10546 tablet_bootstrap.cc:654] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.417425 9949 master_service.cc:946] ReplaceTablet: received request to replace tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:31.418370 10544 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:31.418485 10546 tablet_bootstrap.cc:492] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:31.418529 10544 ts_tablet_manager.cc:1397] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.035s user 0.014s sys 0.012s
I20260925 04:54:31.418637 10546 ts_tablet_manager.cc:1397] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20260925 04:54:31.419255 10544 raft_consensus.cc:348] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.419485 10544 raft_consensus.cc:374] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.419363 10546 raft_consensus.cc:348] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.419579 10544 raft_consensus.cc:729] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.419579 10546 raft_consensus.cc:374] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.419670 10546 raft_consensus.cc:729] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.419889 10546 consensus_queue.cc:260] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.420393 10546 ts_tablet_manager.cc:1428] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:31.419811 10544 consensus_queue.cc:260] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.421656 10544 ts_tablet_manager.cc:1428] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260925 04:54:31.426566 9949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Sending DeleteTablet for 3 replicas of tablet b8dbd8c5232c4c28a1b37b31ae7c03f4
I20260925 04:54:31.427237 9949 catalog_manager.cc:6565] ReplaceTablet: tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 deleted and replaced by tablet f77ef0a1af5645cab8b20ececf6cd688
I20260925 04:54:31.428053 10123 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 with delete_type TABLET_DATA_DELETED (replaced by tablet f77ef0a1af5645cab8b20ececf6cd688) from {username='slave'} at 127.0.0.1:57708
I20260925 04:54:31.428786 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 with delete_type TABLET_DATA_DELETED (replaced by tablet f77ef0a1af5645cab8b20ececf6cd688) from {username='slave'} at 127.0.0.1:48866
I20260925 04:54:31.429049 10557 tablet_replica.cc:330] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:31.429234 10557 raft_consensus.cc:2229] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:31.429334 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 with delete_type TABLET_DATA_DELETED (replaced by tablet f77ef0a1af5645cab8b20ececf6cd688) from {username='slave'} at 127.0.0.1:59588
I20260925 04:54:31.429394 10557 raft_consensus.cc:2258] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.429960 10677 tablet_replica.cc:330] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:31.429971 10557 ts_tablet_manager.cc:1905] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.428622 10676 tablet_replica.cc:330] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:31.430253 10676 raft_consensus.cc:2229] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:31.430282 10677 raft_consensus.cc:2229] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:31.430459 10676 raft_consensus.cc:2258] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.430950 10676 ts_tablet_manager.cc:1905] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.433357 10677 pending_rounds.cc:62] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Trying to abort 1 pending ops.
I20260925 04:54:31.433561 10677 pending_rounds.cc:68] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118242156978176 op_type: NO_OP noop_request { }
I20260925 04:54:31.435561 10677 raft_consensus.cc:2866] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:31.435730 10677 raft_consensus.cc:2258] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.435722 9949 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d4b6c4952014527bf94de01bc05571f from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:31.436585 10677 ts_tablet_manager.cc:1905] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.437104 10261 tablet_service.cc:1467] Processing CreateTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.437520 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77ef0a1af5645cab8b20ececf6cd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.441150 10123 tablet_service.cc:1467] Processing CreateTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.441665 10396 tablet_service.cc:1467] Processing CreateTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.445300 9949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Sending DeleteTablet for 3 replicas of tablet 2d4b6c4952014527bf94de01bc05571f
I20260925 04:54:31.445744 9949 catalog_manager.cc:6565] ReplaceTablet: tablet 2d4b6c4952014527bf94de01bc05571f deleted and replaced by tablet f87a3076f3b7473da51e379d44c6d19e
I20260925 04:54:31.446049 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d4b6c4952014527bf94de01bc05571f with delete_type TABLET_DATA_DELETED (replaced by tablet f87a3076f3b7473da51e379d44c6d19e) from {username='slave'} at 127.0.0.1:59588
I20260925 04:54:31.446311 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d4b6c4952014527bf94de01bc05571f with delete_type TABLET_DATA_DELETED (replaced by tablet f87a3076f3b7473da51e379d44c6d19e) from {username='slave'} at 127.0.0.1:48866
I20260925 04:54:31.446640 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d4b6c4952014527bf94de01bc05571f with delete_type TABLET_DATA_DELETED (replaced by tablet f87a3076f3b7473da51e379d44c6d19e) from {username='slave'} at 127.0.0.1:57708
I20260925 04:54:31.451941 10397 tablet_service.cc:1467] Processing CreateTablet for tablet f87a3076f3b7473da51e379d44c6d19e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.451942 10124 tablet_service.cc:1467] Processing CreateTablet for tablet f87a3076f3b7473da51e379d44c6d19e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.452046 10262 tablet_service.cc:1467] Processing CreateTablet for tablet f87a3076f3b7473da51e379d44c6d19e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:31.452570 9949 master_service.cc:946] ReplaceTablet: received request to replace tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:31.453091 9949 master_service.cc:946] ReplaceTablet: received request to replace tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:31.453485 9949 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d4b6c4952014527bf94de01bc05571f from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:31.454054 9949 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_8e8ca768548d4f2887c17d8046fe4c32" } new_table_name: "default.Table_421a98a632c24f8296c302eef981e44f" modify_external_catalogs: true
I20260925 04:54:31.458725 10123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77ef0a1af5645cab8b20ececf6cd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.459281 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f87a3076f3b7473da51e379d44c6d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.459311 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f87a3076f3b7473da51e379d44c6d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.461757 10545 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:31.463279 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f87a3076f3b7473da51e379d44c6d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.463424 10545 tablet_bootstrap.cc:654] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.463781 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77ef0a1af5645cab8b20ececf6cd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:31.469542 10544 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:31.471236 10544 tablet_bootstrap.cc:654] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.477157 10544 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:31.477308 10544 ts_tablet_manager.cc:1397] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260925 04:54:31.478062 10544 raft_consensus.cc:348] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.478298 10544 raft_consensus.cc:374] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.478391 10544 raft_consensus.cc:729] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.479111 10544 consensus_queue.cc:260] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.479978 10546 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:31.481997 10544 ts_tablet_manager.cc:1428] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 04:54:31.482285 10544 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:31.482844 10546 tablet_bootstrap.cc:654] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.483160 10545 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:31.483331 10545 ts_tablet_manager.cc:1397] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.011s
I20260925 04:54:31.483820 10544 tablet_bootstrap.cc:654] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.484176 10545 raft_consensus.cc:348] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.484440 10545 raft_consensus.cc:374] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.484535 10545 raft_consensus.cc:729] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.484814 10545 consensus_queue.cc:260] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.485589 10545 ts_tablet_manager.cc:1428] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:31.486555 10545 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:31.486773 10544 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:31.486922 10544 ts_tablet_manager.cc:1397] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260925 04:54:31.487614 10544 raft_consensus.cc:348] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.487825 10544 raft_consensus.cc:374] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.487918 10544 raft_consensus.cc:729] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.488617 10545 tablet_bootstrap.cc:654] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.488859 10544 consensus_queue.cc:260] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.489689 10544 ts_tablet_manager.cc:1428] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:31.489887 10546 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:31.490106 10546 ts_tablet_manager.cc:1397] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260925 04:54:31.490887 10546 raft_consensus.cc:348] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.491190 10546 raft_consensus.cc:374] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.491348 10546 raft_consensus.cc:729] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.491660 10546 consensus_queue.cc:260] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.493551 10546 ts_tablet_manager.cc:1428] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:31.493877 10546 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:31.494737 10545 tablet_bootstrap.cc:492] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:31.494920 10545 ts_tablet_manager.cc:1397] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260925 04:54:31.495471 10546 tablet_bootstrap.cc:654] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:31.495996 10545 raft_consensus.cc:348] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.496210 10545 raft_consensus.cc:374] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.496322 10545 raft_consensus.cc:729] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.496562 10545 consensus_queue.cc:260] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.497117 10545 ts_tablet_manager.cc:1428] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:31.498024 10546 tablet_bootstrap.cc:492] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:31.498152 10546 ts_tablet_manager.cc:1397] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260925 04:54:31.498867 10546 raft_consensus.cc:348] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.499073 10546 raft_consensus.cc:374] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:31.499176 10546 raft_consensus.cc:729] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:31.499410 10546 consensus_queue.cc:260] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.499891 10546 ts_tablet_manager.cc:1428] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:31.563992 10557 ts_tablet_manager.cc:1918] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:31.563992 10677 ts_tablet_manager.cc:1918] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:31.564056 10676 ts_tablet_manager.cc:1918] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:31.564182 10677 log.cc:1196] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/b8dbd8c5232c4c28a1b37b31ae7c03f4
I20260925 04:54:31.564195 10557 log.cc:1196] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/b8dbd8c5232c4c28a1b37b31ae7c03f4
I20260925 04:54:31.564198 10676 log.cc:1196] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/b8dbd8c5232c4c28a1b37b31ae7c03f4
I20260925 04:54:31.564572 10557 ts_tablet_manager.cc:1939] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:31.564571 10676 ts_tablet_manager.cc:1939] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:31.564604 10677 ts_tablet_manager.cc:1939] T b8dbd8c5232c4c28a1b37b31ae7c03f4 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:31.565587 10557 tablet_replica.cc:330] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:31.565587 10677 tablet_replica.cc:330] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:31.565598 10676 tablet_replica.cc:330] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:31.565763 10677 raft_consensus.cc:2229] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:31.565773 10557 raft_consensus.cc:2229] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:31.565825 10676 raft_consensus.cc:2229] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:31.565940 10557 raft_consensus.cc:2258] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.565937 10677 raft_consensus.cc:2258] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.566206 10676 pending_rounds.cc:62] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:31.566362 10676 pending_rounds.cc:68] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118243109253120 op_type: NO_OP noop_request { }
I20260925 04:54:31.566447 10557 ts_tablet_manager.cc:1905] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.566452 10677 ts_tablet_manager.cc:1905] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.566558 10676 raft_consensus.cc:2866] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:31.566699 10676 raft_consensus.cc:2258] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:31.567179 9940 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:31.567714 10676 ts_tablet_manager.cc:1905] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:31.569276 9938 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:31.570849 9939 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet b8dbd8c5232c4c28a1b37b31ae7c03f4 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:31.602747 10552 raft_consensus.cc:482] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:31.603029 10552 raft_consensus.cc:504] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.603642 10552 leader_election.cc:288] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.604262 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d712e2b2c89468c9d0aa4453bcfa658" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:31.604259 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d712e2b2c89468c9d0aa4453bcfa658" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:31.604506 10417 raft_consensus.cc:2454] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:31.604518 10144 raft_consensus.cc:2454] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:31.604905 10218 leader_election.cc:302] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.605240 10552 raft_consensus.cc:2781] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:31.605341 10552 raft_consensus.cc:482] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:31.605423 10552 raft_consensus.cc:3037] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.645576 10551 raft_consensus.cc:482] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:31.645812 10551 raft_consensus.cc:504] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.646420 10551 leader_election.cc:288] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.646991 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54118ca3f7364c60b5cda9a1983cd640" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:31.646991 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54118ca3f7364c60b5cda9a1983cd640" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:31.647235 10417 raft_consensus.cc:2454] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:31.647241 10282 raft_consensus.cc:2454] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:31.647655 10077 leader_election.cc:302] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.647945 10551 raft_consensus.cc:2781] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:31.648041 10551 raft_consensus.cc:482] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:31.648166 10551 raft_consensus.cc:3037] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.669006 10551 raft_consensus.cc:504] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.669088 10552 raft_consensus.cc:504] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.669760 10551 leader_election.cc:288] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.669823 10552 leader_election.cc:288] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.673846 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d712e2b2c89468c9d0aa4453bcfa658" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:31.674070 10416 raft_consensus.cc:3037] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.674826 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54118ca3f7364c60b5cda9a1983cd640" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:31.675426 10417 raft_consensus.cc:3037] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.676829 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d712e2b2c89468c9d0aa4453bcfa658" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:31.677047 10144 raft_consensus.cc:3037] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.677047 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54118ca3f7364c60b5cda9a1983cd640" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:31.677250 10282 raft_consensus.cc:3037] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.705237 10551 raft_consensus.cc:482] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:31.705478 10551 raft_consensus.cc:504] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.706058 10551 leader_election.cc:288] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.706707 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77ef0a1af5645cab8b20ececf6cd688" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:31.706734 10415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77ef0a1af5645cab8b20ececf6cd688" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:31.706954 10281 raft_consensus.cc:2454] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:31.706971 10415 raft_consensus.cc:2454] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:31.707368 10077 leader_election.cc:302] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.707676 10551 raft_consensus.cc:2781] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:31.707787 10551 raft_consensus.cc:482] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:31.707868 10551 raft_consensus.cc:3037] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.770329 10282 raft_consensus.cc:2454] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.770339 10144 raft_consensus.cc:2454] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:31.770964 10077 leader_election.cc:302] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.771303 10676 ts_tablet_manager.cc:1918] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:31.771533 10676 log.cc:1196] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/2d4b6c4952014527bf94de01bc05571f
I20260925 04:54:31.771548 10218 leader_election.cc:302] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.772032 10676 ts_tablet_manager.cc:1939] T 2d4b6c4952014527bf94de01bc05571f P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:31.772444 10552 raft_consensus.cc:2781] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:31.774216 10552 raft_consensus.cc:686] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:31.774492 10557 ts_tablet_manager.cc:1918] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:31.774689 10552 consensus_queue.cc:237] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:31.775139 10416 raft_consensus.cc:2454] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:31.774744 10557 log.cc:1196] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/2d4b6c4952014527bf94de01bc05571f
I20260925 04:54:31.776933 10684 raft_consensus.cc:2781] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:31.777133 9940 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 2d4b6c4952014527bf94de01bc05571f (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:31.777855 10677 ts_tablet_manager.cc:1918] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:31.778007 10677 log.cc:1196] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/2d4b6c4952014527bf94de01bc05571f
I20260925 04:54:31.778298 10557 ts_tablet_manager.cc:1939] T 2d4b6c4952014527bf94de01bc05571f P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:31.778672 10677 ts_tablet_manager.cc:1939] T 2d4b6c4952014527bf94de01bc05571f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:31.778630 10684 raft_consensus.cc:686] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:31.778944 10684 consensus_queue.cc:237] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.780268 9938 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 2d4b6c4952014527bf94de01bc05571f (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:31.872542 10417 raft_consensus.cc:2454] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.872536 10551 raft_consensus.cc:504] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.873320 10551 leader_election.cc:288] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:31.874106 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77ef0a1af5645cab8b20ececf6cd688" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:31.874375 10282 raft_consensus.cc:3037] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.874415 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77ef0a1af5645cab8b20ececf6cd688" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:31.874661 10417 raft_consensus.cc:3037] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:31.877204 10282 raft_consensus.cc:2454] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.877661 10077 leader_election.cc:302] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:31.877971 10551 raft_consensus.cc:2781] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:31.878122 10551 raft_consensus.cc:686] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:31.878225 10417 raft_consensus.cc:2454] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:31.878386 10551 consensus_queue.cc:237] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:31.878991 9939 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 2d4b6c4952014527bf94de01bc05571f (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:31.951807 10690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:31.952111 10690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:31.952329 10691 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:31.952512 10691 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:31.953301 10691 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:31.954473 10690 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:31.954464 9963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:31.954927 9962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:31.955515 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:31.955767 9823 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 1.
I20260925 04:54:31.956218 10579 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:31.956585 10690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 04:54:31.956738 10690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:31.956837 10690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 1 FOLLOWER]: Advancing to term 2
I20260925 04:54:31.961045 10603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:31.975919 10690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:31.976430 10603 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37499e1d150b41169507d4dd098579b5 in current term 2: Already voted for candidate 9c78f840b646474a98deff6bac54d5cc in this term.
I20260925 04:54:31.977174 9962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc"
I20260925 04:54:31.977792 10690 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:31.978820 9799 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:31.979540 10691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 04:54:31.980641 9823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5"
I20260925 04:54:32.057646 10694 consensus_queue.cc:1035] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.064904 10696 consensus_queue.cc:1035] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.073889 10603 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Rejecting Update request from peer 39da3a5fade344af9db436d10052b4bc for earlier term 1. Current term is 2. Ops: []
I20260925 04:54:32.074514 10699 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 }, Status: INVALID_TERM, Last received: 1.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 04:54:32.075070 10702 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 LEADER]: Stepping down as leader of term 1
I20260925 04:54:32.075155 10702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Running, Role: LEADER
I20260925 04:54:32.075479 10702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:32.075949 10702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 1 FOLLOWER]: Advancing to term 2
I20260925 04:54:32.082505 9951 catalog_manager.cc:2148] created HMS catalog entry for table [id=27c0608f6eee489492ab4e3bb85230ba]
W20260925 04:54:32.083520 9951 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:32.094317 10691 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 04:54:32.099764 9823 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 2.
I20260925 04:54:32.100401 9822 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Rejecting Update request from peer 39da3a5fade344af9db436d10052b4bc for earlier term 1. Current term is 2. Ops: []
I20260925 04:54:32.103323 10579 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:32.103806 10690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Leader election won for term 2
I20260925 04:54:32.104285 10690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 LEADER]: Becoming Leader. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Running, Role: LEADER
I20260925 04:54:32.104839 10690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 24, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:32.106423 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.106879 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:32.107513 10704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:32.110936 10704 catalog_manager.cc:669] Loaded metadata for table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:32.111773 10704 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:32.112239 10704 catalog_manager.cc:669] Loaded metadata for table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:32.112633 10704 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:32.112972 10704 catalog_manager.cc:669] Loaded metadata for table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:32.113201 10552 raft_consensus.cc:482] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:32.113344 10552 raft_consensus.cc:504] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:32.114013 10552 leader_election.cc:288] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:32.114784 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f87a3076f3b7473da51e379d44c6d19e" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:32.114897 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f87a3076f3b7473da51e379d44c6d19e" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:32.115046 10144 raft_consensus.cc:2454] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:32.115134 10417 raft_consensus.cc:2454] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:32.115442 10704 tablet_loader.cc:96] loaded metadata for tablet 4e7f407cf2bc44838b85ebd44955acef (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:32.115592 10218 leader_election.cc:302] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:32.115814 10704 tablet_loader.cc:96] loaded metadata for tablet 54118ca3f7364c60b5cda9a1983cd640 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:32.115900 10552 raft_consensus.cc:2781] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:32.116008 10552 raft_consensus.cc:482] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:32.116122 10552 raft_consensus.cc:3037] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:32.116228 10704 tablet_loader.cc:96] loaded metadata for tablet 9d712e2b2c89468c9d0aa4453bcfa658 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:32.116770 10704 tablet_loader.cc:96] loaded metadata for tablet f77ef0a1af5645cab8b20ececf6cd688 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:32.117164 10704 tablet_loader.cc:96] loaded metadata for tablet f87a3076f3b7473da51e379d44c6d19e (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:32.117650 10704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:32.118906 10704 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:32.118973 10704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:32.120172 10704 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:32.121156 10704 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Loaded TSK: 0
I20260925 04:54:32.122439 10704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:32.123632 10704 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:32.125165 10704 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 1
I20260925 04:54:32.201574 10552 raft_consensus.cc:504] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:32.202462 10552 leader_election.cc:288] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:32.203043 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f87a3076f3b7473da51e379d44c6d19e" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:32.203081 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f87a3076f3b7473da51e379d44c6d19e" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:32.203239 10144 raft_consensus.cc:3037] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:32.203313 10417 raft_consensus.cc:3037] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:32.205323 10144 raft_consensus.cc:2454] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:32.205749 10218 leader_election.cc:302] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:32.206050 10552 raft_consensus.cc:2781] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:32.206208 10552 raft_consensus.cc:686] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:32.206454 10552 consensus_queue.cc:237] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:32.210143 10592 catalog_manager.cc:5495] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130). New cstate: current_term: 1 leader_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:32.220969 9822 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Refusing update from remote peer 9c78f840b646474a98deff6bac54d5cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20260925 04:54:32.221308 9962 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Refusing update from remote peer 9c78f840b646474a98deff6bac54d5cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 2 index: 26. (index mismatch)
I20260925 04:54:32.221624 10703 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 04:54:32.222002 10690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 04:54:32.223968 10691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.224339 10691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:32.225020 10702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.225315 10702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:32.227406 10702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.228052 10702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:32.228351 10708 mvcc.cc:205] Tried to move back new op lower bound from 7333118247811182592 to 7333118247345557504. Current Snapshot: MvccSnapshot[applied={T|T < 7333118247811182592 or (T in {7333118247811182592})}]
I20260925 04:54:32.229097 10691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.229372 10691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:32.231973 10707 mvcc.cc:205] Tried to move back new op lower bound from 7333118247811182592 to 7333118247345557504. Current Snapshot: MvccSnapshot[applied={T|T < 7333118247811182592 or (T in {7333118247811182592})}]
I20260925 04:54:32.232820 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.233073 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:32.232885 10710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:32.233289 10710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:32.304487 10417 raft_consensus.cc:2454] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:32.313038 9948 catalog_manager.cc:2148] created HMS catalog entry for table [id=b224d52b3fcf402392e92c06fab50ac9]
W20260925 04:54:32.313994 9948 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:32.453517 10010 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:32.513137 9944 catalog_manager.cc:2148] created HMS catalog entry for table [id=d4db82a7afd846539ba823bf792e493b]
W20260925 04:54:32.514086 9944 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:32.700497 10552 consensus_queue.cc:1035] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.702296 10191 heartbeater.cc:503] Master 127.9.81.189:45475 was elected leader, sending a full tablet report...
I20260925 04:54:32.705026 10592 catalog_manager.cc:5495] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 270ea27d66a1425eae85f73563e04c00 (127.9.81.129). New cstate: current_term: 1 leader_uuid: "270ea27d66a1425eae85f73563e04c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:32.705749 10592 catalog_manager.cc:5495] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 270ea27d66a1425eae85f73563e04c00 (127.9.81.129). New cstate: current_term: 1 leader_uuid: "270ea27d66a1425eae85f73563e04c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:32.706383 10329 heartbeater.cc:503] Master 127.9.81.189:45475 was elected leader, sending a full tablet report...
I20260925 04:54:32.706310 10592 catalog_manager.cc:5495] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130). New cstate: current_term: 1 leader_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } }
I20260925 04:54:32.708689 10717 consensus_queue.cc:1035] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.710378 10464 heartbeater.cc:503] Master 127.9.81.189:45475 was elected leader, sending a full tablet report...
I20260925 04:54:32.725145 9945 catalog_manager.cc:2148] created HMS catalog entry for table [id=0275d9aeebbb43e4b3fc0f1024d2856e]
W20260925 04:54:32.726014 9945 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:32.732501 10713 consensus_queue.cc:1035] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.747933 10722 consensus_queue.cc:1035] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.755891 10722 consensus_queue.cc:1035] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.761324 10722 consensus_queue.cc:1035] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:32.881783 9542 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu pid 9782
I20260925 04:54:32.883162 9843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 04:54:32.918780 9946 catalog_manager.cc:2148] created HMS catalog entry for table [id=275ebdadce0a4c988813c6a91371ab32]
W20260925 04:54:32.919837 9946 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
W20260925 04:54:32.924559 10009 hms_notification_log_listener.cc:134] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events
I20260925 04:54:32.925271 9953 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60174 (request call id 11) took 2537 ms. Trace:
I20260925 04:54:32.925398 9953 rpcz_store.cc:276] 0925 04:54:30.388269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:30.388327 (+ 58us) service_pool.cc:227] Handling call
0925 04:54:32.925209 (+2536882us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 04:54:32.925896 9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.81.129:47033 (request call id 14) took 1444 ms (client timeout 1000 ms). Trace:
W20260925 04:54:32.926446 9953 rpcz_store.cc:269] 0925 04:54:31.481396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.925645 (+1444249us) service_pool.cc:214] Skipping call since client already timed out
0925 04:54:32.925817 (+ 172us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260925 04:54:32.926770 9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.81.130:55885 (request call id 12) took 1440 ms (client timeout 1000 ms). Trace:
W20260925 04:54:32.926870 9953 rpcz_store.cc:269] 0925 04:54:31.486453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.926684 (+1440231us) service_pool.cc:214] Skipping call since client already timed out
0925 04:54:32.926717 (+ 33us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260925 04:54:32.927107 9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.81.131:41397 (request call id 13) took 1434 ms (client timeout 1000 ms). Trace:
W20260925 04:54:32.927199 9953 rpcz_store.cc:269] 0925 04:54:31.493140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.927024 (+1433884us) service_pool.cc:214] Skipping call since client already timed out
0925 04:54:32.927056 (+ 32us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260925 04:54:32.929100 10472 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:32.929409 9947 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9a7f064f807444c69ef2ae958de42e7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 04:54:32.930544 9950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_93ed1c5bfdde46bfa22c83e91ab4a5ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:32.934010 9953 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 26) took 1869 ms. Trace:
I20260925 04:54:32.934347 9953 rpcz_store.cc:276] 0925 04:54:31.064125 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.933585 (+1869460us) service_pool.cc:227] Handling call
0925 04:54:32.933954 (+ 369us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.935021 9953 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60174 (request call id 27) took 1765 ms. Trace:
I20260925 04:54:32.935207 9953 rpcz_store.cc:276] 0925 04:54:31.169485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.934611 (+1765126us) service_pool.cc:227] Handling call
0925 04:54:32.934967 (+ 356us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 04:54:32.936882 10472 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.188:40705)
I20260925 04:54:32.943907 9953 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60174 (request call id 28) took 1574 ms. Trace:
I20260925 04:54:32.944087 9953 rpcz_store.cc:276] 0925 04:54:31.369361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.943473 (+1574112us) service_pool.cc:227] Handling call
0925 04:54:32.943841 (+ 368us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.944895 9953 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 29) took 1574 ms. Trace:
I20260925 04:54:32.945075 9953 rpcz_store.cc:276] 0925 04:54:31.370134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.944449 (+1574315us) service_pool.cc:227] Handling call
0925 04:54:32.944839 (+ 390us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.945853 9953 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 30) took 1376 ms. Trace:
I20260925 04:54:32.946030 9953 rpcz_store.cc:276] 0925 04:54:31.569636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.945445 (+1375809us) service_pool.cc:227] Handling call
0925 04:54:32.945800 (+ 355us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.946484 9953 master_service.cc:946] ReplaceTablet: received request to replace tablet 4e7f407cf2bc44838b85ebd44955acef from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:32.946947 9953 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60174 (request call id 31) took 1271 ms. Trace:
I20260925 04:54:32.947173 9953 rpcz_store.cc:276] 0925 04:54:31.675854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.946413 (+1270559us) service_pool.cc:227] Handling call
0925 04:54:32.946912 (+ 499us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.947599 9953 master_service.cc:946] ReplaceTablet: received request to replace tablet 4e7f407cf2bc44838b85ebd44955acef from {username='slave'} at 127.0.0.1:60174
W20260925 04:54:32.947854 10472 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.188:40705)
I20260925 04:54:32.948032 9953 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60174 (request call id 32) took 1272 ms. Trace:
I20260925 04:54:32.948704 9953 rpcz_store.cc:276] 0925 04:54:31.675964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.947547 (+1271583us) service_pool.cc:227] Handling call
0925 04:54:32.947975 (+ 428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.949621 9953 master_service.cc:946] ReplaceTablet: received request to replace tablet 54118ca3f7364c60b5cda9a1983cd640 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:32.950153 9953 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60174 (request call id 33) took 1274 ms. Trace:
I20260925 04:54:32.950348 9953 rpcz_store.cc:276] 0925 04:54:31.676081 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.949532 (+1273451us) service_pool.cc:227] Handling call
0925 04:54:32.950101 (+ 569us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.951123 9953 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d4b6c4952014527bf94de01bc05571f from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:32.951545 9953 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60174 (request call id 34) took 1274 ms. Trace:
I20260925 04:54:32.951735 9953 rpcz_store.cc:276] 0925 04:54:31.677353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.951060 (+1273707us) service_pool.cc:227] Handling call
0925 04:54:32.951493 (+ 433us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.954454 9953 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d712e2b2c89468c9d0aa4453bcfa658 from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:32.954840 9953 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60174 (request call id 35) took 1277 ms. Trace:
I20260925 04:54:32.955009 9953 rpcz_store.cc:276] 0925 04:54:31.677794 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.954383 (+1276589us) service_pool.cc:227] Handling call
0925 04:54:32.954808 (+ 425us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.956765 9953 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:60190 (request call id 0) took 1885 ms. Trace:
I20260925 04:54:32.956930 9953 rpcz_store.cc:276] 0925 04:54:31.071395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.956397 (+1885002us) service_pool.cc:227] Handling call
0925 04:54:32.956732 (+ 335us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 04:54:32.958554 10517 master_runner.cc:232] Existing masters have differing terms: 1 vs 2
I20260925 04:54:32.958772 10517 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:32.969446 10591 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_e28617bb40fa4c7fac94b5a3467e7570" } new_table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" modify_external_catalogs: true
I20260925 04:54:32.970108 10590 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_946f8d86c819438fbca12b46346be9a7" } new_table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" modify_external_catalogs: true
I20260925 04:54:32.970671 10589 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_95c110b2e1554ef3a459f6eca6e29381"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:32.971423 10588 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_97aab5f07e904b7580396563fdcec71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:32.971949 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d4b6c4952014527bf94de01bc05571f from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:32.972671 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d712e2b2c89468c9d0aa4453bcfa658 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:32.975102 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 54118ca3f7364c60b5cda9a1983cd640 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:32.976449 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 4e7f407cf2bc44838b85ebd44955acef from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:32.977656 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet 4e7f407cf2bc44838b85ebd44955acef from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:32.978199 10592 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_c4023953be09425f877d1e8a30f45361" } new_table_name: "default.Table_48a023979ead4432a298d53c804329da" modify_external_catalogs: true
I20260925 04:54:32.968904 10593 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:32.981101 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 9d712e2b2c89468c9d0aa4453bcfa658
I20260925 04:54:32.984951 10717 consensus_queue.cc:1035] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 04:54:32.989275 10589 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_95c110b2e1554ef3a459f6eca6e29381 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:32.991207 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 4e7f407cf2bc44838b85ebd44955acef
I20260925 04:54:32.992007 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 4e7f407cf2bc44838b85ebd44955acef deleted and replaced by tablet e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:32.993722 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 54118ca3f7364c60b5cda9a1983cd640
I20260925 04:54:32.994150 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 54118ca3f7364c60b5cda9a1983cd640 deleted and replaced by tablet ef45a1fed3af4c0988ce11af80bd56b2
I20260925 04:54:33.005162 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 9d712e2b2c89468c9d0aa4453bcfa658 deleted and replaced by tablet 6c8c09913c28433b8624f9e8d7e4deef
I20260925 04:54:33.044508 10552 consensus_queue.cc:1035] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:33.044757 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e7f407cf2bc44838b85ebd44955acef with delete_type TABLET_DATA_DELETED (replaced by tablet e0ba96df6e334a31a8fd628de0725c3d) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.044843 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 with delete_type TABLET_DATA_DELETED (replaced by tablet ef45a1fed3af4c0988ce11af80bd56b2) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.045077 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c09913c28433b8624f9e8d7e4deef) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.047839 10260 tablet_service.cc:1467] Processing CreateTablet for tablet e0ba96df6e334a31a8fd628de0725c3d (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.048341 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ba96df6e334a31a8fd628de0725c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.054024 10741 tablet_replica.cc:330] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.054795 10741 raft_consensus.cc:2229] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.055472 10741 raft_consensus.cc:2258] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.056041 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.056447 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c8c09913c28433b8624f9e8d7e4deef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.056903 10741 ts_tablet_manager.cc:1905] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.062973 10259 tablet_service.cc:1467] Processing CreateTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.063390 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef45a1fed3af4c0988ce11af80bd56b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.068234 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c09913c28433b8624f9e8d7e4deef) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.069691 10741 ts_tablet_manager.cc:1918] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.069851 10741 log.cc:1196] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/4e7f407cf2bc44838b85ebd44955acef
I20260925 04:54:33.070279 10741 ts_tablet_manager.cc:1939] T 4e7f407cf2bc44838b85ebd44955acef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.071034 10741 tablet_replica.cc:330] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.071131 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 4e7f407cf2bc44838b85ebd44955acef (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.071311 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e7f407cf2bc44838b85ebd44955acef with delete_type TABLET_DATA_DELETED (replaced by tablet e0ba96df6e334a31a8fd628de0725c3d) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.071352 10741 raft_consensus.cc:2229] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.071523 10741 raft_consensus.cc:2258] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.071884 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 with delete_type TABLET_DATA_DELETED (replaced by tablet ef45a1fed3af4c0988ce11af80bd56b2) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.072049 10744 tablet_replica.cc:330] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.072256 10744 raft_consensus.cc:2229] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.072829 10741 ts_tablet_manager.cc:1905] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.072594 10397 tablet_service.cc:1467] Processing CreateTablet for tablet e0ba96df6e334a31a8fd628de0725c3d (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.072685 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.073431 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c8c09913c28433b8624f9e8d7e4deef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.073393 10395 tablet_service.cc:1467] Processing CreateTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.073853 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef45a1fed3af4c0988ce11af80bd56b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.077358 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ba96df6e334a31a8fd628de0725c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.078442 10741 ts_tablet_manager.cc:1918] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.078627 10741 log.cc:1196] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/54118ca3f7364c60b5cda9a1983cd640
I20260925 04:54:33.079079 10741 ts_tablet_manager.cc:1939] T 54118ca3f7364c60b5cda9a1983cd640 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.080008 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 54118ca3f7364c60b5cda9a1983cd640 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.080340 10741 tablet_replica.cc:330] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.080525 10741 raft_consensus.cc:2229] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.080910 10741 raft_consensus.cc:2258] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.081684 10741 ts_tablet_manager.cc:1905] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.073406 10744 raft_consensus.cc:2258] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.087234 10741 ts_tablet_manager.cc:1918] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.087813 10744 ts_tablet_manager.cc:1905] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.087975 10741 log.cc:1196] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/9d712e2b2c89468c9d0aa4453bcfa658
I20260925 04:54:33.093374 10744 ts_tablet_manager.cc:1918] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.093858 10741 ts_tablet_manager.cc:1939] T 9d712e2b2c89468c9d0aa4453bcfa658 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.094795 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 9d712e2b2c89468c9d0aa4453bcfa658 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.095139 10744 log.cc:1196] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/9d712e2b2c89468c9d0aa4453bcfa658
I20260925 04:54:33.095552 10744 ts_tablet_manager.cc:1939] T 9d712e2b2c89468c9d0aa4453bcfa658 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.096387 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 9d712e2b2c89468c9d0aa4453bcfa658 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.096721 10744 tablet_replica.cc:330] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.096961 10744 raft_consensus.cc:2229] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.097520 10744 raft_consensus.cc:2258] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.098131 10744 ts_tablet_manager.cc:1905] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.101202 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d712e2b2c89468c9d0aa4453bcfa658 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c09913c28433b8624f9e8d7e4deef) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.101588 10123 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e7f407cf2bc44838b85ebd44955acef with delete_type TABLET_DATA_DELETED (replaced by tablet e0ba96df6e334a31a8fd628de0725c3d) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.101824 10122 tablet_service.cc:1514] Processing DeleteTablet for tablet 54118ca3f7364c60b5cda9a1983cd640 with delete_type TABLET_DATA_DELETED (replaced by tablet ef45a1fed3af4c0988ce11af80bd56b2) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.102288 10121 tablet_service.cc:1467] Processing CreateTablet for tablet e0ba96df6e334a31a8fd628de0725c3d (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.102725 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ba96df6e334a31a8fd628de0725c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.105312 10120 tablet_service.cc:1467] Processing CreateTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.105736 10120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c8c09913c28433b8624f9e8d7e4deef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.109836 10119 tablet_service.cc:1467] Processing CreateTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.110234 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef45a1fed3af4c0988ce11af80bd56b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.113309 9542 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu with pid 9782
I20260925 04:54:33.115974 10745 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.118268 10745 tablet_bootstrap.cc:654] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.119923 10743 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.129706 10747 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.134979 10746 tablet_replica.cc:330] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.135284 10746 raft_consensus.cc:2229] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.135552 10746 raft_consensus.cc:2258] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.136392 10746 ts_tablet_manager.cc:1905] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.137342 10747 tablet_bootstrap.cc:654] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.147787 10746 ts_tablet_manager.cc:1918] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.148021 10746 log.cc:1196] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/9d712e2b2c89468c9d0aa4453bcfa658
I20260925 04:54:33.148528 10746 ts_tablet_manager.cc:1939] T 9d712e2b2c89468c9d0aa4453bcfa658 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.149994 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 9d712e2b2c89468c9d0aa4453bcfa658 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.150617 10746 tablet_replica.cc:330] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.150884 10746 raft_consensus.cc:2229] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.151060 10747 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.151212 10747 ts_tablet_manager.cc:1397] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260925 04:54:33.151260 10746 raft_consensus.cc:2258] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.151875 10746 ts_tablet_manager.cc:1905] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.151957 10747 raft_consensus.cc:348] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.152213 10747 raft_consensus.cc:374] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.152318 10747 raft_consensus.cc:729] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.152562 10747 consensus_queue.cc:260] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.153182 10747 ts_tablet_manager.cc:1428] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:33.153503 10747 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.155186 10747 tablet_bootstrap.cc:654] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.156332 10743 tablet_bootstrap.cc:654] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.164269 10744 ts_tablet_manager.cc:1918] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.164464 10744 log.cc:1196] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/4e7f407cf2bc44838b85ebd44955acef
I20260925 04:54:33.165076 10744 ts_tablet_manager.cc:1939] T 4e7f407cf2bc44838b85ebd44955acef P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.166345 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 4e7f407cf2bc44838b85ebd44955acef (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.166740 10744 tablet_replica.cc:330] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.166935 10744 raft_consensus.cc:2229] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.167128 10744 raft_consensus.cc:2258] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.167966 10743 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.168119 10743 ts_tablet_manager.cc:1397] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.002s
W20260925 04:54:33.168177 10579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.81.190:37617 (error 108)
I20260925 04:54:33.168918 10747 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.168890 10743 raft_consensus.cc:348] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.169111 10747 ts_tablet_manager.cc:1397] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260925 04:54:33.169159 10743 raft_consensus.cc:374] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.169253 10743 raft_consensus.cc:729] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.170027 10747 raft_consensus.cc:348] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.170321 10747 raft_consensus.cc:374] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.170406 10747 raft_consensus.cc:729] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.170732 10747 consensus_queue.cc:260] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.172430 10744 ts_tablet_manager.cc:1905] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.174000 10743 consensus_queue.cc:260] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.174376 10747 ts_tablet_manager.cc:1428] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 04:54:33.175751 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet f87a3076f3b7473da51e379d44c6d19e from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.175997 10743 ts_tablet_manager.cc:1428] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 04:54:33.176271 10743 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.177927 10743 tablet_bootstrap.cc:654] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.181140 10747 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.182399 10746 ts_tablet_manager.cc:1918] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.182641 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet f87a3076f3b7473da51e379d44c6d19e
I20260925 04:54:33.183188 10584 catalog_manager.cc:6565] ReplaceTablet: tablet f87a3076f3b7473da51e379d44c6d19e deleted and replaced by tablet 2b47a6aee0b74ff18a39ba173610a0d9
I20260925 04:54:33.183372 10746 log.cc:1196] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/4e7f407cf2bc44838b85ebd44955acef
I20260925 04:54:33.183568 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet f87a3076f3b7473da51e379d44c6d19e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b47a6aee0b74ff18a39ba173610a0d9) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.184362 10746 ts_tablet_manager.cc:1939] T 4e7f407cf2bc44838b85ebd44955acef P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.185782 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet f87a3076f3b7473da51e379d44c6d19e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b47a6aee0b74ff18a39ba173610a0d9) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.185868 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 4e7f407cf2bc44838b85ebd44955acef (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.186105 10741 tablet_replica.cc:330] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.186287 10741 raft_consensus.cc:2229] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.186604 10741 raft_consensus.cc:2258] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.187346 10747 tablet_bootstrap.cc:654] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.187505 10741 ts_tablet_manager.cc:1905] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 04:54:33.188313 10217 connection.cc:535] client connection to 127.9.81.190:37617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:33.188571 10352 connection.cc:535] client connection to 127.9.81.190:37617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:33.188694 9939 connection.cc:535] server connection from 127.0.0.1:60158 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 04:54:33.193348 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.193876 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b47a6aee0b74ff18a39ba173610a0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.200026 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c8c09913c28433b8624f9e8d7e4deef from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.203599 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet f87a3076f3b7473da51e379d44c6d19e from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.205056 10741 ts_tablet_manager.cc:1918] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.205209 10741 log.cc:1196] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/f87a3076f3b7473da51e379d44c6d19e
I20260925 04:54:33.205687 10741 ts_tablet_manager.cc:1939] T f87a3076f3b7473da51e379d44c6d19e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.206431 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet f77ef0a1af5645cab8b20ececf6cd688 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.207695 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 6c8c09913c28433b8624f9e8d7e4deef
I20260925 04:54:33.208293 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 6c8c09913c28433b8624f9e8d7e4deef deleted and replaced by tablet daad8b413ced48319a7a4d8539b2e2be
I20260925 04:54:33.212387 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef with delete_type TABLET_DATA_DELETED (replaced by tablet daad8b413ced48319a7a4d8539b2e2be) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.214454 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet e0ba96df6e334a31a8fd628de0725c3d from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.214936 10746 tablet_replica.cc:330] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.215215 10746 raft_consensus.cc:2229] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.215685 10746 raft_consensus.cc:2258] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.217195 10746 ts_tablet_manager.cc:1905] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.218832 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet f77ef0a1af5645cab8b20ececf6cd688
I20260925 04:54:33.219302 10585 catalog_manager.cc:6565] ReplaceTablet: tablet f77ef0a1af5645cab8b20ececf6cd688 deleted and replaced by tablet f43280241c7d44179332297f12fef510
I20260925 04:54:33.219861 10722 raft_consensus.cc:482] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:33.220116 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 with delete_type TABLET_DATA_DELETED (replaced by tablet f43280241c7d44179332297f12fef510) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.218001 10747 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.221171 10747 ts_tablet_manager.cc:1397] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260925 04:54:33.220017 10722 raft_consensus.cc:504] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.222021 10722 leader_election.cc:288] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.222620 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef45a1fed3af4c0988ce11af80bd56b2" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
W20260925 04:54:33.223456 10077 leader_election.cc:341] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
W20260925 04:54:33.219609 10579 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.81.190:37617, user_credentials={real_user=slave}} blocked reactor thread for 51483us
I20260925 04:54:33.223892 10124 tablet_service.cc:1467] Processing CreateTablet for tablet daad8b413ced48319a7a4d8539b2e2be (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.224337 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daad8b413ced48319a7a4d8539b2e2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.224673 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet f87a3076f3b7473da51e379d44c6d19e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b47a6aee0b74ff18a39ba173610a0d9) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.226999 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.227479 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b47a6aee0b74ff18a39ba173610a0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.228675 10119 tablet_service.cc:1467] Processing CreateTablet for tablet f43280241c7d44179332297f12fef510 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.229200 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43280241c7d44179332297f12fef510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.222986 10747 raft_consensus.cc:348] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.231302 10747 raft_consensus.cc:374] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.231455 10747 raft_consensus.cc:729] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.231737 10747 consensus_queue.cc:260] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.232350 10747 ts_tablet_manager.cc:1428] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260925 04:54:33.232663 10747 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.239400 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.239814 10584 catalog_manager.cc:6565] ReplaceTablet: tablet e0ba96df6e334a31a8fd628de0725c3d deleted and replaced by tablet e998c16b2ebb4e25b93c225197d07ccb
W20260925 04:54:33.239866 10757 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:33.195514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.190:37617 (local address 127.9.81.129:34169)
0925 04:54:33.237251 (+ 41737us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:33.237455 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":41589,"threads_started":1}
I20260925 04:54:33.240732 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ba96df6e334a31a8fd628de0725c3d with delete_type TABLET_DATA_DELETED (replaced by tablet e998c16b2ebb4e25b93c225197d07ccb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.241016 10745 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.241173 10745 ts_tablet_manager.cc:1397] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.125s user 0.011s sys 0.021s
I20260925 04:54:33.241889 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef with delete_type TABLET_DATA_DELETED (replaced by tablet daad8b413ced48319a7a4d8539b2e2be) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.242000 10745 raft_consensus.cc:348] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.242276 10745 raft_consensus.cc:374] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.242393 10745 raft_consensus.cc:729] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.242471 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 with delete_type TABLET_DATA_DELETED (replaced by tablet f43280241c7d44179332297f12fef510) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.242661 10745 consensus_queue.cc:260] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.243364 10745 ts_tablet_manager.cc:1428] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:33.243630 10745 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.244740 10747 tablet_bootstrap.cc:654] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.245150 10745 tablet_bootstrap.cc:654] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.245839 10746 ts_tablet_manager.cc:1918] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.246009 10746 log.cc:1196] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/54118ca3f7364c60b5cda9a1983cd640
I20260925 04:54:33.246495 10746 ts_tablet_manager.cc:1939] T 54118ca3f7364c60b5cda9a1983cd640 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.247510 10746 tablet_replica.cc:330] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.247745 10746 raft_consensus.cc:2229] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.247725 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 54118ca3f7364c60b5cda9a1983cd640 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.247987 10746 raft_consensus.cc:2258] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.248687 10746 ts_tablet_manager.cc:1905] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.249910 10744 ts_tablet_manager.cc:1918] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.250036 10744 log.cc:1196] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/54118ca3f7364c60b5cda9a1983cd640
I20260925 04:54:33.250577 10744 ts_tablet_manager.cc:1939] T 54118ca3f7364c60b5cda9a1983cd640 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.251263 10119 tablet_service.cc:1467] Processing CreateTablet for tablet e998c16b2ebb4e25b93c225197d07ccb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.251745 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e998c16b2ebb4e25b93c225197d07ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.253903 10395 tablet_service.cc:1467] Processing CreateTablet for tablet daad8b413ced48319a7a4d8539b2e2be (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.253903 10397 tablet_service.cc:1467] Processing CreateTablet for tablet f43280241c7d44179332297f12fef510 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.254420 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43280241c7d44179332297f12fef510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.254637 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ba96df6e334a31a8fd628de0725c3d with delete_type TABLET_DATA_DELETED (replaced by tablet e998c16b2ebb4e25b93c225197d07ccb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.255456 10396 tablet_service.cc:1467] Processing CreateTablet for tablet e998c16b2ebb4e25b93c225197d07ccb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.255927 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e998c16b2ebb4e25b93c225197d07ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.261533 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daad8b413ced48319a7a4d8539b2e2be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 04:54:33.262473 10579 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc -> Peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Couldn't send request to peer 37499e1d150b41169507d4dd098579b5. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:33.262939 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 54118ca3f7364c60b5cda9a1983cd640 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
W20260925 04:54:33.263998 10755 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:33.189152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.190:37617 (local address 127.9.81.130:34235)
0925 04:54:33.244513 (+ 55361us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:33.244708 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":55217,"threads_started":1}
I20260925 04:54:33.264837 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet f87a3076f3b7473da51e379d44c6d19e (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.265486 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.265846 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b47a6aee0b74ff18a39ba173610a0d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 04:54:33.273931 10756 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:33.189494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.190:37617 (local address 127.9.81.131:43191)
0925 04:54:33.272790 (+ 83296us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:33.272913 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":83165,"threads_started":1}
I20260925 04:54:33.274876 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef45a1fed3af4c0988ce11af80bd56b2" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:33.275118 10417 raft_consensus.cc:2454] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:33.278004 10078 leader_election.cc:302] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:33.278422 10722 raft_consensus.cc:2781] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:33.278512 10722 raft_consensus.cc:482] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:33.278594 10722 raft_consensus.cc:3037] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.280893 10722 raft_consensus.cc:504] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.282107 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef45a1fed3af4c0988ce11af80bd56b2" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
W20260925 04:54:33.282683 10077 leader_election.cc:341] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:33.282902 10722 leader_election.cc:288] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.283738 10745 tablet_bootstrap.cc:492] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.283885 10745 ts_tablet_manager.cc:1397] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.004s
I20260925 04:54:33.284402 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet f77ef0a1af5645cab8b20ececf6cd688 with delete_type TABLET_DATA_DELETED (replaced by tablet f43280241c7d44179332297f12fef510) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.284574 10745 raft_consensus.cc:348] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.284787 10745 raft_consensus.cc:374] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.284849 10745 raft_consensus.cc:729] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.284937 10262 tablet_service.cc:1467] Processing CreateTablet for tablet daad8b413ced48319a7a4d8539b2e2be (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.285102 10745 consensus_queue.cc:260] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.285377 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daad8b413ced48319a7a4d8539b2e2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.287791 10745 ts_tablet_manager.cc:1428] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:33.289649 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef45a1fed3af4c0988ce11af80bd56b2" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:33.289772 10745 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.289883 10417 raft_consensus.cc:3037] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.291343 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef with delete_type TABLET_DATA_DELETED (replaced by tablet daad8b413ced48319a7a4d8539b2e2be) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.291567 10741 tablet_replica.cc:330] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.291750 10741 raft_consensus.cc:2229] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.291930 10741 raft_consensus.cc:2258] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.292685 10417 raft_consensus.cc:2454] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:33.292761 10741 ts_tablet_manager.cc:1905] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.292680 10745 tablet_bootstrap.cc:654] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.293689 10078 leader_election.cc:302] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:33.294100 10722 raft_consensus.cc:2781] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:33.297650 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ba96df6e334a31a8fd628de0725c3d with delete_type TABLET_DATA_DELETED (replaced by tablet e998c16b2ebb4e25b93c225197d07ccb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.298141 10260 tablet_service.cc:1467] Processing CreateTablet for tablet f43280241c7d44179332297f12fef510 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.298632 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43280241c7d44179332297f12fef510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.305403 10259 tablet_service.cc:1467] Processing CreateTablet for tablet e998c16b2ebb4e25b93c225197d07ccb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.305788 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e998c16b2ebb4e25b93c225197d07ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.321878 10746 ts_tablet_manager.cc:1918] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.322474 10746 log.cc:1196] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/f87a3076f3b7473da51e379d44c6d19e
I20260925 04:54:33.323374 10746 ts_tablet_manager.cc:1939] T f87a3076f3b7473da51e379d44c6d19e P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.324941 10743 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.325204 10743 ts_tablet_manager.cc:1397] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.149s user 0.016s sys 0.015s
I20260925 04:54:33.326010 10741 ts_tablet_manager.cc:1918] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.326146 10741 log.cc:1196] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/f77ef0a1af5645cab8b20ececf6cd688
I20260925 04:54:33.326308 10743 raft_consensus.cc:348] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.326602 10741 ts_tablet_manager.cc:1939] T f77ef0a1af5645cab8b20ececf6cd688 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.326638 10743 raft_consensus.cc:374] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.326728 10743 raft_consensus.cc:729] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.327059 10743 consensus_queue.cc:260] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.327648 10744 tablet_replica.cc:330] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.327823 10741 tablet_replica.cc:330] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.327982 10744 raft_consensus.cc:2229] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.328006 10741 raft_consensus.cc:2229] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.328164 10741 raft_consensus.cc:2258] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.328267 10744 raft_consensus.cc:2258] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.328347 10743 ts_tablet_manager.cc:1428] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:33.329090 10743 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.329267 10722 raft_consensus.cc:686] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:33.329576 10722 consensus_queue.cc:237] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.330816 10743 tablet_bootstrap.cc:654] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.331377 10747 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.331586 10747 ts_tablet_manager.cc:1397] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.005s
I20260925 04:54:33.331872 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet f77ef0a1af5645cab8b20ececf6cd688 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.332393 10747 raft_consensus.cc:348] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.332618 10747 raft_consensus.cc:374] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.332688 10747 raft_consensus.cc:729] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
W20260925 04:54:33.332813 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 6c8c09913c28433b8624f9e8d7e4deef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c8c09913c28433b8624f9e8d7e4deef already in progress: creating tablet
I20260925 04:54:33.333580 10745 tablet_bootstrap.cc:492] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.333709 10745 ts_tablet_manager.cc:1397] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.012s
I20260925 04:54:33.334407 10745 raft_consensus.cc:348] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.334630 10745 raft_consensus.cc:374] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.334724 10745 raft_consensus.cc:729] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.334957 10745 consensus_queue.cc:260] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.335453 10745 ts_tablet_manager.cc:1428] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:33.335845 10745 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.337286 10744 ts_tablet_manager.cc:1905] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.337638 10745 tablet_bootstrap.cc:654] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.339543 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet f87a3076f3b7473da51e379d44c6d19e (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.339654 10746 tablet_replica.cc:330] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.339854 10746 raft_consensus.cc:2229] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.340032 10746 raft_consensus.cc:2258] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.342481 10743 tablet_bootstrap.cc:492] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.342645 10743 ts_tablet_manager.cc:1397] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260925 04:54:33.342685 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c8c09913c28433b8624f9e8d7e4deef with delete_type TABLET_DATA_DELETED (replaced by tablet daad8b413ced48319a7a4d8539b2e2be) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.343420 10743 raft_consensus.cc:348] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.343652 10743 raft_consensus.cc:374] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.343755 10743 raft_consensus.cc:729] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.343987 10743 consensus_queue.cc:260] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.344472 10747 consensus_queue.cc:260] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.344317 10585 catalog_manager.cc:5495] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 270ea27d66a1425eae85f73563e04c00 (127.9.81.129). New cstate: current_term: 1 leader_uuid: "270ea27d66a1425eae85f73563e04c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:33.344763 10743 ts_tablet_manager.cc:1428] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260925 04:54:33.345026 10743 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.345988 10747 ts_tablet_manager.cc:1428] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.014s user 0.000s sys 0.001s
I20260925 04:54:33.346589 10743 tablet_bootstrap.cc:654] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.347028 10747 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.348402 10747 tablet_bootstrap.cc:654] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.352620 10744 ts_tablet_manager.cc:1918] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.352767 10744 log.cc:1196] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/f87a3076f3b7473da51e379d44c6d19e
I20260925 04:54:33.357095 10746 ts_tablet_manager.cc:1905] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.359298 10741 ts_tablet_manager.cc:1905] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.364818 10741 ts_tablet_manager.cc:1918] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.365038 10741 log.cc:1196] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.365527 10744 ts_tablet_manager.cc:1939] T f87a3076f3b7473da51e379d44c6d19e P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.365573 10741 ts_tablet_manager.cc:1939] T e0ba96df6e334a31a8fd628de0725c3d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.366513 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet f87a3076f3b7473da51e379d44c6d19e (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.366909 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e0ba96df6e334a31a8fd628de0725c3d (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.367228 10743 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.367250 10741 tablet_replica.cc:330] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.367408 10743 ts_tablet_manager.cc:1397] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260925 04:54:33.367604 10741 raft_consensus.cc:2229] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.367821 10741 raft_consensus.cc:2258] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.368219 10743 raft_consensus.cc:348] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.368454 10743 raft_consensus.cc:374] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.368538 10743 raft_consensus.cc:729] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.368580 10741 ts_tablet_manager.cc:1905] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.368775 10743 consensus_queue.cc:260] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.369561 10747 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.369704 10747 ts_tablet_manager.cc:1397] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260925 04:54:33.370425 10747 raft_consensus.cc:348] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.370654 10747 raft_consensus.cc:374] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.370750 10747 raft_consensus.cc:729] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.371047 10743 ts_tablet_manager.cc:1428] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:33.371582 10745 tablet_bootstrap.cc:492] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.371754 10745 ts_tablet_manager.cc:1397] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.001s
I20260925 04:54:33.372349 10744 tablet_replica.cc:330] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.372871 10743 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.374513 10743 tablet_bootstrap.cc:654] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.375819 10744 raft_consensus.cc:2229] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.381181 10747 consensus_queue.cc:260] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.381757 10744 raft_consensus.cc:2258] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.372493 10745 raft_consensus.cc:348] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.382047 10745 raft_consensus.cc:374] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.382196 10745 raft_consensus.cc:729] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.382561 10745 consensus_queue.cc:260] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.387807 10745 ts_tablet_manager.cc:1428] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260925 04:54:33.390152 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet ef45a1fed3af4c0988ce11af80bd56b2 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.392174 10745 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.394398 10745 tablet_bootstrap.cc:654] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.396245 10741 ts_tablet_manager.cc:1918] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.396402 10741 log.cc:1196] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/6c8c09913c28433b8624f9e8d7e4deef
I20260925 04:54:33.396839 10741 ts_tablet_manager.cc:1939] T 6c8c09913c28433b8624f9e8d7e4deef P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.398252 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet ef45a1fed3af4c0988ce11af80bd56b2
I20260925 04:54:33.398315 10746 ts_tablet_manager.cc:1918] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.398432 10746 log.cc:1196] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/6c8c09913c28433b8624f9e8d7e4deef
I20260925 04:54:33.398887 10746 ts_tablet_manager.cc:1939] T 6c8c09913c28433b8624f9e8d7e4deef P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.399020 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5ef41c8f954157837991c18e486201) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.399554 10744 ts_tablet_manager.cc:1905] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.399869 10722 raft_consensus.cc:482] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:33.399946 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 6c8c09913c28433b8624f9e8d7e4deef (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.400027 10722 raft_consensus.cc:504] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.401134 10722 leader_election.cc:288] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:33.402233 10077 leader_election.cc:341] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.402823 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ba96df6e334a31a8fd628de0725c3d" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:33.402935 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 6c8c09913c28433b8624f9e8d7e4deef (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.403045 10417 raft_consensus.cc:2454] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:33.403429 10078 leader_election.cc:302] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:33.403760 10722 raft_consensus.cc:2781] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:33.403888 10722 raft_consensus.cc:482] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:33.403967 10722 raft_consensus.cc:3037] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.405812 10746 tablet_replica.cc:330] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.406739 10722 raft_consensus.cc:504] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.408948 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ba96df6e334a31a8fd628de0725c3d" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:33.409168 10417 raft_consensus.cc:3037] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.411842 10417 raft_consensus.cc:2454] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:33.413532 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet daad8b413ced48319a7a4d8539b2e2be from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.414403 10078 leader_election.cc:302] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:33.414708 10761 raft_consensus.cc:2781] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:33.415201 10761 raft_consensus.cc:686] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:33.415475 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet e998c16b2ebb4e25b93c225197d07ccb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.415529 10761 consensus_queue.cc:237] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
W20260925 04:54:33.418358 10077 leader_election.cc:341] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.418519 10722 leader_election.cc:288] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.423449 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet e998c16b2ebb4e25b93c225197d07ccb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.424052 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e998c16b2ebb4e25b93c225197d07ccb
I20260925 04:54:33.424625 10587 catalog_manager.cc:6565] ReplaceTablet: tablet e998c16b2ebb4e25b93c225197d07ccb deleted and replaced by tablet e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:33.425277 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5ef41c8f954157837991c18e486201) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.425508 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet e998c16b2ebb4e25b93c225197d07ccb with delete_type TABLET_DATA_DELETED (replaced by tablet e59a45c74ec54b53bfc86c386bb15d19) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.425683 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet ef45a1fed3af4c0988ce11af80bd56b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5ef41c8f954157837991c18e486201) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.425669 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet e998c16b2ebb4e25b93c225197d07ccb with delete_type TABLET_DATA_DELETED (replaced by tablet e59a45c74ec54b53bfc86c386bb15d19) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.426165 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet daad8b413ced48319a7a4d8539b2e2be
I20260925 04:54:33.426313 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet e998c16b2ebb4e25b93c225197d07ccb with delete_type TABLET_DATA_DELETED (replaced by tablet e59a45c74ec54b53bfc86c386bb15d19) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.425909 10741 tablet_replica.cc:330] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.426633 10741 raft_consensus.cc:2229] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.426630 10585 catalog_manager.cc:6565] ReplaceTablet: tablet daad8b413ced48319a7a4d8539b2e2be deleted and replaced by tablet b0023759f681412c9efe6a68e6a76800
I20260925 04:54:33.426810 10741 raft_consensus.cc:2258] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.427611 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet daad8b413ced48319a7a4d8539b2e2be with delete_type TABLET_DATA_DELETED (replaced by tablet b0023759f681412c9efe6a68e6a76800) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.427807 10584 catalog_manager.cc:6565] ReplaceTablet: tablet ef45a1fed3af4c0988ce11af80bd56b2 deleted and replaced by tablet 7d5ef41c8f954157837991c18e486201
I20260925 04:54:33.427872 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet daad8b413ced48319a7a4d8539b2e2be with delete_type TABLET_DATA_DELETED (replaced by tablet b0023759f681412c9efe6a68e6a76800) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.428473 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet daad8b413ced48319a7a4d8539b2e2be with delete_type TABLET_DATA_DELETED (replaced by tablet b0023759f681412c9efe6a68e6a76800) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.431981 10747 ts_tablet_manager.cc:1428] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.062s user 0.001s sys 0.002s
I20260925 04:54:33.432089 10741 ts_tablet_manager.cc:1905] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.432202 10746 raft_consensus.cc:2229] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.432544 10746 raft_consensus.cc:2258] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.433512 10746 ts_tablet_manager.cc:1905] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.436396 10747 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.446249 10743 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.446460 10743 ts_tablet_manager.cc:1397] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.074s user 0.013s sys 0.025s
I20260925 04:54:33.447259 10743 raft_consensus.cc:348] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.447503 10743 raft_consensus.cc:374] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.447618 10743 raft_consensus.cc:729] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.447858 10743 consensus_queue.cc:260] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.448521 10743 ts_tablet_manager.cc:1428] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:33.448798 10743 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.450241 10744 ts_tablet_manager.cc:1918] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.450390 10744 log.cc:1196] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/6c8c09913c28433b8624f9e8d7e4deef
I20260925 04:54:33.450819 10744 ts_tablet_manager.cc:1939] T 6c8c09913c28433b8624f9e8d7e4deef P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.452625 10745 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.452769 10745 ts_tablet_manager.cc:1397] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.061s user 0.023s sys 0.003s
I20260925 04:54:33.453181 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 6c8c09913c28433b8624f9e8d7e4deef (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.453615 10745 raft_consensus.cc:348] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.453837 10745 raft_consensus.cc:374] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.453933 10745 raft_consensus.cc:729] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.454156 10745 consensus_queue.cc:260] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.454344 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet f43280241c7d44179332297f12fef510 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.454717 10745 ts_tablet_manager.cc:1428] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:33.454985 10745 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.456544 10746 ts_tablet_manager.cc:1918] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.456717 10746 log.cc:1196] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/f77ef0a1af5645cab8b20ececf6cd688
I20260925 04:54:33.457082 10745 tablet_bootstrap.cc:654] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.452613 10744 tablet_replica.cc:330] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.458498 10744 raft_consensus.cc:2229] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.458709 10744 raft_consensus.cc:2258] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.460065 10747 tablet_bootstrap.cc:654] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.460865 10743 tablet_bootstrap.cc:654] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.465371 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:33.465648 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:33.469596 10744 ts_tablet_manager.cc:1905] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.472257 10119 tablet_service.cc:1467] Processing CreateTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.472704 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59a45c74ec54b53bfc86c386bb15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.478547 10741 ts_tablet_manager.cc:1918] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.478740 10741 log.cc:1196] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/ef45a1fed3af4c0988ce11af80bd56b2
I20260925 04:54:33.478828 10396 tablet_service.cc:1467] Processing CreateTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.479089 10741 ts_tablet_manager.cc:1939] T ef45a1fed3af4c0988ce11af80bd56b2 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.479216 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59a45c74ec54b53bfc86c386bb15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.482201 10744 ts_tablet_manager.cc:1918] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.485025 10745 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.485208 10745 ts_tablet_manager.cc:1397] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.001s
I20260925 04:54:33.485206 10744 log.cc:1196] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/f77ef0a1af5645cab8b20ececf6cd688
I20260925 04:54:33.485829 10744 ts_tablet_manager.cc:1939] T f77ef0a1af5645cab8b20ececf6cd688 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.486104 10745 raft_consensus.cc:348] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.486343 10745 raft_consensus.cc:374] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.486310 10260 tablet_service.cc:1467] Processing CreateTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.486425 10745 raft_consensus.cc:729] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.486707 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e59a45c74ec54b53bfc86c386bb15d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.486677 10745 consensus_queue.cc:260] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.487196 10745 ts_tablet_manager.cc:1428] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:33.488286 10741 tablet_replica.cc:330] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.488488 10741 raft_consensus.cc:2229] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.488698 10741 raft_consensus.cc:2258] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.488879 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet f77ef0a1af5645cab8b20ececf6cd688 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.489107 10745 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.489315 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet ef45a1fed3af4c0988ce11af80bd56b2 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
W20260925 04:54:33.489595 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet e998c16b2ebb4e25b93c225197d07ccb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e998c16b2ebb4e25b93c225197d07ccb already in progress: creating tablet
I20260925 04:54:33.491781 10744 tablet_replica.cc:330] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.492046 10745 tablet_bootstrap.cc:654] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.492244 10744 raft_consensus.cc:2229] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.493187 10744 raft_consensus.cc:2258] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.494189 10744 ts_tablet_manager.cc:1905] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.496627 10259 tablet_service.cc:1467] Processing CreateTablet for tablet b0023759f681412c9efe6a68e6a76800 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.497026 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0023759f681412c9efe6a68e6a76800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.496685 10395 tablet_service.cc:1467] Processing CreateTablet for tablet b0023759f681412c9efe6a68e6a76800 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.501441 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0023759f681412c9efe6a68e6a76800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.504179 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5ef41c8f954157837991c18e486201 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.504590 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5ef41c8f954157837991c18e486201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.505942 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5ef41c8f954157837991c18e486201 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.506443 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5ef41c8f954157837991c18e486201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.511209 10741 ts_tablet_manager.cc:1905] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.512013 10743 tablet_bootstrap.cc:492] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.512174 10743 ts_tablet_manager.cc:1397] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20260925 04:54:33.512902 10743 raft_consensus.cc:348] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.513165 10743 raft_consensus.cc:374] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.513257 10743 raft_consensus.cc:729] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.513542 10743 consensus_queue.cc:260] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.514074 10743 ts_tablet_manager.cc:1428] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:33.515219 10743 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.516891 10743 tablet_bootstrap.cc:654] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.517061 10741 ts_tablet_manager.cc:1918] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.517196 10741 log.cc:1196] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/daad8b413ced48319a7a4d8539b2e2be
I20260925 04:54:33.517673 10741 ts_tablet_manager.cc:1939] T daad8b413ced48319a7a4d8539b2e2be P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.518608 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet daad8b413ced48319a7a4d8539b2e2be (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.518946 10746 ts_tablet_manager.cc:1939] T f77ef0a1af5645cab8b20ececf6cd688 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.519969 10746 tablet_replica.cc:330] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.520145 10746 raft_consensus.cc:2229] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.520381 10746 pending_rounds.cc:62] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:33.520452 10746 pending_rounds.cc:68] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118252712906752 op_type: NO_OP noop_request { }
I20260925 04:54:33.520625 10746 raft_consensus.cc:2866] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:33.520720 10746 raft_consensus.cc:2258] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.521521 10746 ts_tablet_manager.cc:1905] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.523629 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet f77ef0a1af5645cab8b20ececf6cd688 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.527041 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.528179 10747 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.528520 10747 ts_tablet_manager.cc:1397] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.004s
I20260925 04:54:33.528692 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.529404 10743 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.529320 10747 raft_consensus.cc:348] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.529528 10743 ts_tablet_manager.cc:1397] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260925 04:54:33.530203 10747 raft_consensus.cc:374] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.530316 10747 raft_consensus.cc:729] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.530427 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5ef41c8f954157837991c18e486201 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.530827 10747 consensus_queue.cc:260] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.530931 10743 raft_consensus.cc:348] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.531116 10743 raft_consensus.cc:374] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.531199 10743 raft_consensus.cc:729] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.531417 10747 ts_tablet_manager.cc:1428] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:33.532153 10747 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.532105 10743 consensus_queue.cc:260] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.533476 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d5ef41c8f954157837991c18e486201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.534469 10743 ts_tablet_manager.cc:1428] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 04:54:33.535359 10743 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.536374 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet e998c16b2ebb4e25b93c225197d07ccb with delete_type TABLET_DATA_DELETED (replaced by tablet e59a45c74ec54b53bfc86c386bb15d19) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.537292 10119 tablet_service.cc:1467] Processing CreateTablet for tablet b0023759f681412c9efe6a68e6a76800 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.537644 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0023759f681412c9efe6a68e6a76800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.542932 10747 tablet_bootstrap.cc:654] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.550494 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.550735 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet f43280241c7d44179332297f12fef510
I20260925 04:54:33.553160 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.553802 10585 catalog_manager.cc:6565] ReplaceTablet: tablet f43280241c7d44179332297f12fef510 deleted and replaced by tablet b6975bf0c943455188a956bf9d2970bd
I20260925 04:54:33.555764 10728 raft_consensus.cc:482] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:33.555941 10728 raft_consensus.cc:504] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.556690 10728 leader_election.cc:288] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.557623 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e998c16b2ebb4e25b93c225197d07ccb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:33.557999 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:46148
W20260925 04:54:33.558476 10353 leader_election.cc:341] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:33.562904 10747 tablet_bootstrap.cc:492] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.563191 10747 ts_tablet_manager.cc:1397] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260925 04:54:33.563947 10395 tablet_service.cc:1467] Processing CreateTablet for tablet b6975bf0c943455188a956bf9d2970bd (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.564033 10747 raft_consensus.cc:348] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.564349 10747 raft_consensus.cc:374] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.564383 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6975bf0c943455188a956bf9d2970bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.564497 10747 raft_consensus.cc:729] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.564750 10747 consensus_queue.cc:260] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.566335 10747 ts_tablet_manager.cc:1428] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 04:54:33.567669 10747 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.569540 10744 ts_tablet_manager.cc:1918] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.569687 10744 log.cc:1196] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.570050 10744 ts_tablet_manager.cc:1939] T e0ba96df6e334a31a8fd628de0725c3d P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.570905 10744 tablet_replica.cc:330] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.571117 10744 raft_consensus.cc:2229] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.571278 10744 raft_consensus.cc:2258] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.571275 10746 ts_tablet_manager.cc:1918] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.571650 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e0ba96df6e334a31a8fd628de0725c3d (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.571841 10747 tablet_bootstrap.cc:654] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.571987 10746 log.cc:1196] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e0ba96df6e334a31a8fd628de0725c3d
I20260925 04:54:33.573398 10746 ts_tablet_manager.cc:1939] T e0ba96df6e334a31a8fd628de0725c3d P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.575588 10119 tablet_service.cc:1467] Processing CreateTablet for tablet b6975bf0c943455188a956bf9d2970bd (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.575991 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6975bf0c943455188a956bf9d2970bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.576738 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e0ba96df6e334a31a8fd628de0725c3d (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.577099 10746 tablet_replica.cc:330] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.578330 10260 tablet_service.cc:1467] Processing CreateTablet for tablet b6975bf0c943455188a956bf9d2970bd (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.578439 10744 ts_tablet_manager.cc:1905] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.578814 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e998c16b2ebb4e25b93c225197d07ccb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:33.579028 10282 raft_consensus.cc:2454] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:33.579309 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet f43280241c7d44179332297f12fef510 with delete_type TABLET_DATA_DELETED (replaced by tablet b6975bf0c943455188a956bf9d2970bd) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.579813 10351 leader_election.cc:302] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 270ea27d66a1425eae85f73563e04c00
W20260925 04:54:33.580025 10351 raft_consensus.cc:2670] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 04:54:33.580333 10745 tablet_bootstrap.cc:492] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.580348 10741 tablet_replica.cc:330] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.580668 10743 tablet_bootstrap.cc:654] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.580922 10746 raft_consensus.cc:2229] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:33.582101 10741 raft_consensus.cc:2229] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.582263 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6975bf0c943455188a956bf9d2970bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.582391 10741 raft_consensus.cc:2258] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.582774 10746 pending_rounds.cc:62] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:33.582885 10746 pending_rounds.cc:68] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118252361134080 op_type: NO_OP noop_request { }
I20260925 04:54:33.583066 10746 raft_consensus.cc:2866] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:33.583206 10746 raft_consensus.cc:2258] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.585551 10741 ts_tablet_manager.cc:1905] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.587683 10746 ts_tablet_manager.cc:1905] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.580473 10745 ts_tablet_manager.cc:1397] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.091s user 0.014s sys 0.026s
I20260925 04:54:33.590353 10745 raft_consensus.cc:348] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.590629 10745 raft_consensus.cc:374] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.590751 10745 raft_consensus.cc:729] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.591130 10745 consensus_queue.cc:260] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.592932 10741 ts_tablet_manager.cc:1918] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.593072 10745 ts_tablet_manager.cc:1428] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 04:54:33.593176 10741 log.cc:1196] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/f43280241c7d44179332297f12fef510
I20260925 04:54:33.593357 10745 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.593627 10741 ts_tablet_manager.cc:1939] T f43280241c7d44179332297f12fef510 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.594544 10741 tablet_replica.cc:330] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.594688 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet f43280241c7d44179332297f12fef510 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.594749 10741 raft_consensus.cc:2229] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.595029 10741 raft_consensus.cc:2258] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.595641 10741 ts_tablet_manager.cc:1905] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.596019 10745 tablet_bootstrap.cc:654] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.602115 10741 ts_tablet_manager.cc:1918] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.602308 10741 log.cc:1196] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e998c16b2ebb4e25b93c225197d07ccb
I20260925 04:54:33.602785 10741 ts_tablet_manager.cc:1939] T e998c16b2ebb4e25b93c225197d07ccb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.603219 10743 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.603402 10743 ts_tablet_manager.cc:1397] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.002s
I20260925 04:54:33.604300 10743 raft_consensus.cc:348] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.604365 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e998c16b2ebb4e25b93c225197d07ccb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.604509 10743 raft_consensus.cc:374] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.604569 10743 raft_consensus.cc:729] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
W20260925 04:54:33.605185 10578 catalog_manager.cc:4808] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet f43280241c7d44179332297f12fef510 because the tablet was not found. No further retry: Not found: Tablet not found: f43280241c7d44179332297f12fef510
I20260925 04:54:33.605432 10747 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.605608 10747 ts_tablet_manager.cc:1397] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260925 04:54:33.606297 10747 raft_consensus.cc:348] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.606524 10747 raft_consensus.cc:374] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.606599 10747 raft_consensus.cc:729] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.606817 10747 consensus_queue.cc:260] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.608029 10747 ts_tablet_manager.cc:1428] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:33.608322 10747 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.610695 10744 ts_tablet_manager.cc:1918] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.610857 10744 log.cc:1196] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e998c16b2ebb4e25b93c225197d07ccb
I20260925 04:54:33.611219 10744 ts_tablet_manager.cc:1939] T e998c16b2ebb4e25b93c225197d07ccb P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.612223 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e998c16b2ebb4e25b93c225197d07ccb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.612854 10744 tablet_replica.cc:330] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.613571 10745 tablet_bootstrap.cc:492] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.613750 10745 ts_tablet_manager.cc:1397] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260925 04:54:33.614454 10745 raft_consensus.cc:348] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.614699 10745 raft_consensus.cc:374] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.614775 10745 raft_consensus.cc:729] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.615003 10745 consensus_queue.cc:260] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.615762 10745 ts_tablet_manager.cc:1428] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:33.616060 10745 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.618412 10745 tablet_bootstrap.cc:654] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.619371 10744 raft_consensus.cc:2229] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.619565 10744 raft_consensus.cc:2258] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.613432 10743 consensus_queue.cc:260] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.620692 10743 ts_tablet_manager.cc:1428] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260925 04:54:33.621034 10743 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.621976 10744 ts_tablet_manager.cc:1905] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.624346 10747 tablet_bootstrap.cc:654] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.627053 10746 ts_tablet_manager.cc:1918] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:33.628167 10744 ts_tablet_manager.cc:1918] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.628294 10744 log.cc:1196] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/ef45a1fed3af4c0988ce11af80bd56b2
I20260925 04:54:33.628577 10743 tablet_bootstrap.cc:654] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.628681 10744 ts_tablet_manager.cc:1939] T ef45a1fed3af4c0988ce11af80bd56b2 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.629567 10746 log.cc:1196] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/ef45a1fed3af4c0988ce11af80bd56b2
I20260925 04:54:33.630307 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d5ef41c8f954157837991c18e486201 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.630625 10746 ts_tablet_manager.cc:1939] T ef45a1fed3af4c0988ce11af80bd56b2 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.631774 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet ef45a1fed3af4c0988ce11af80bd56b2 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.632201 10746 tablet_replica.cc:330] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.632946 10746 raft_consensus.cc:2229] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.633255 10746 raft_consensus.cc:2258] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.633373 10745 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.633596 10745 ts_tablet_manager.cc:1397] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s
I20260925 04:54:33.633841 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d5ef41c8f954157837991c18e486201 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.634485 10745 raft_consensus.cc:348] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.634706 10745 raft_consensus.cc:374] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.634804 10745 raft_consensus.cc:729] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.634862 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 2b47a6aee0b74ff18a39ba173610a0d9 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.635057 10745 consensus_queue.cc:260] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.636477 10745 ts_tablet_manager.cc:1428] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:33.636814 10745 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.639807 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 7d5ef41c8f954157837991c18e486201
I20260925 04:54:33.640259 10587 catalog_manager.cc:6565] ReplaceTablet: tablet 7d5ef41c8f954157837991c18e486201 deleted and replaced by tablet fca5ab47510b47408fcad1b94eba0945
I20260925 04:54:33.641198 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d5ef41c8f954157837991c18e486201 with delete_type TABLET_DATA_DELETED (replaced by tablet fca5ab47510b47408fcad1b94eba0945) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.641378 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d5ef41c8f954157837991c18e486201 with delete_type TABLET_DATA_DELETED (replaced by tablet fca5ab47510b47408fcad1b94eba0945) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.642084 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d5ef41c8f954157837991c18e486201 with delete_type TABLET_DATA_DELETED (replaced by tablet fca5ab47510b47408fcad1b94eba0945) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.642362 10746 ts_tablet_manager.cc:1905] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.645339 10745 tablet_bootstrap.cc:654] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.646173 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 2b47a6aee0b74ff18a39ba173610a0d9
I20260925 04:54:33.646584 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 2b47a6aee0b74ff18a39ba173610a0d9 deleted and replaced by tablet 35144ffd80494e38889efc31371f093a
I20260925 04:54:33.646895 10744 tablet_replica.cc:330] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.647110 10744 raft_consensus.cc:2229] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.647300 10744 raft_consensus.cc:2258] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.648197 10744 ts_tablet_manager.cc:1905] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.648545 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 35144ffd80494e38889efc31371f093a) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.649014 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet ef45a1fed3af4c0988ce11af80bd56b2 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.649498 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 35144ffd80494e38889efc31371f093a) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.650177 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b47a6aee0b74ff18a39ba173610a0d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 35144ffd80494e38889efc31371f093a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.654222 10746 ts_tablet_manager.cc:1918] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.654340 10746 log.cc:1196] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e998c16b2ebb4e25b93c225197d07ccb
I20260925 04:54:33.654681 10746 ts_tablet_manager.cc:1939] T e998c16b2ebb4e25b93c225197d07ccb P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.655610 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e998c16b2ebb4e25b93c225197d07ccb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.657774 10745 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.657930 10745 ts_tablet_manager.cc:1397] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260925 04:54:33.658622 10745 raft_consensus.cc:348] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.658860 10745 raft_consensus.cc:374] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.658923 10745 raft_consensus.cc:729] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.659138 10745 consensus_queue.cc:260] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.660845 10745 ts_tablet_manager.cc:1428] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:33.661161 10745 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.661787 10119 tablet_service.cc:1467] Processing CreateTablet for tablet fca5ab47510b47408fcad1b94eba0945 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.662181 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca5ab47510b47408fcad1b94eba0945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.665064 10744 ts_tablet_manager.cc:1918] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.665081 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet b0023759f681412c9efe6a68e6a76800 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.665218 10744 log.cc:1196] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/daad8b413ced48319a7a4d8539b2e2be
I20260925 04:54:33.665411 10260 tablet_service.cc:1467] Processing CreateTablet for tablet fca5ab47510b47408fcad1b94eba0945 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.665524 10745 tablet_bootstrap.cc:654] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.665580 10744 ts_tablet_manager.cc:1939] T daad8b413ced48319a7a4d8539b2e2be P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.665817 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca5ab47510b47408fcad1b94eba0945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.669394 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet daad8b413ced48319a7a4d8539b2e2be (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.670080 10395 tablet_service.cc:1467] Processing CreateTablet for tablet fca5ab47510b47408fcad1b94eba0945 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.670467 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca5ab47510b47408fcad1b94eba0945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.673177 10744 tablet_replica.cc:330] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.673362 10744 raft_consensus.cc:2229] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.673564 10744 raft_consensus.cc:2258] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.673799 10747 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.673938 10747 ts_tablet_manager.cc:1397] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.007s
I20260925 04:54:33.674291 10744 ts_tablet_manager.cc:1905] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.674692 10747 raft_consensus.cc:348] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.674911 10747 raft_consensus.cc:374] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.674988 10747 raft_consensus.cc:729] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.675263 10746 tablet_replica.cc:330] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.675437 10746 raft_consensus.cc:2229] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.675570 10746 raft_consensus.cc:2258] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.676226 10746 ts_tablet_manager.cc:1905] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.679277 10741 tablet_replica.cc:330] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
W20260925 04:54:33.679668 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 7d5ef41c8f954157837991c18e486201 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d5ef41c8f954157837991c18e486201 already in progress: creating tablet
I20260925 04:54:33.680022 10741 raft_consensus.cc:2229] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.680311 10741 raft_consensus.cc:2258] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.681233 10747 consensus_queue.cc:260] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.681821 10745 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.681952 10745 ts_tablet_manager.cc:1397] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260925 04:54:33.682699 10745 raft_consensus.cc:348] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.683298 10745 raft_consensus.cc:374] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.683408 10745 raft_consensus.cc:729] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.683638 10745 consensus_queue.cc:260] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.684188 10745 ts_tablet_manager.cc:1428] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:33.685180 10747 ts_tablet_manager.cc:1428] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20260925 04:54:33.689450 10747 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.690984 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 35144ffd80494e38889efc31371f093a (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.691470 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35144ffd80494e38889efc31371f093a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.691743 10744 ts_tablet_manager.cc:1918] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.692070 10747 tablet_bootstrap.cc:654] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.693923 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 35144ffd80494e38889efc31371f093a (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.694370 10746 ts_tablet_manager.cc:1918] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.694401 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35144ffd80494e38889efc31371f093a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.694501 10746 log.cc:1196] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/daad8b413ced48319a7a4d8539b2e2be
I20260925 04:54:33.694824 10746 ts_tablet_manager.cc:1939] T daad8b413ced48319a7a4d8539b2e2be P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.695799 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet daad8b413ced48319a7a4d8539b2e2be (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.696398 10746 tablet_replica.cc:330] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.696574 10746 raft_consensus.cc:2229] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.696744 10746 raft_consensus.cc:2258] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.691881 10744 log.cc:1196] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/f43280241c7d44179332297f12fef510
I20260925 04:54:33.698246 10746 ts_tablet_manager.cc:1905] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.698369 10744 ts_tablet_manager.cc:1939] T f43280241c7d44179332297f12fef510 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.700026 10744 tablet_replica.cc:330] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.700304 10744 raft_consensus.cc:2229] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.700378 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet f43280241c7d44179332297f12fef510 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.700608 10744 raft_consensus.cc:2258] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 04:54:33.700664 10579 catalog_manager.cc:4808] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet f43280241c7d44179332297f12fef510 because the tablet was not found. No further retry: Not found: Tablet not found: f43280241c7d44179332297f12fef510
I20260925 04:54:33.704182 10747 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.704357 10747 ts_tablet_manager.cc:1397] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20260925 04:54:33.705215 10747 raft_consensus.cc:348] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.705546 10747 raft_consensus.cc:374] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.705627 10747 raft_consensus.cc:729] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.705878 10747 consensus_queue.cc:260] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.709250 10747 ts_tablet_manager.cc:1428] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260925 04:54:33.710596 10747 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.712360 10747 tablet_bootstrap.cc:654] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.714890 10745 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.690598 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 35144ffd80494e38889efc31371f093a (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.715744 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35144ffd80494e38889efc31371f093a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.716646 10745 tablet_bootstrap.cc:654] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.718400 10741 ts_tablet_manager.cc:1905] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.725256 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet b0023759f681412c9efe6a68e6a76800
I20260925 04:54:33.725726 10584 catalog_manager.cc:6565] ReplaceTablet: tablet b0023759f681412c9efe6a68e6a76800 deleted and replaced by tablet e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:33.726343 10746 ts_tablet_manager.cc:1918] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.726589 10746 log.cc:1196] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/f43280241c7d44179332297f12fef510
I20260925 04:54:33.727197 10746 ts_tablet_manager.cc:1939] T f43280241c7d44179332297f12fef510 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.729758 10741 ts_tablet_manager.cc:1918] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.729919 10741 log.cc:1196] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/2b47a6aee0b74ff18a39ba173610a0d9
I20260925 04:54:33.731113 10747 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.731384 10747 ts_tablet_manager.cc:1397] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.003s
I20260925 04:54:33.732589 10747 raft_consensus.cc:348] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.732977 10747 raft_consensus.cc:374] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.733165 10741 ts_tablet_manager.cc:1939] T 2b47a6aee0b74ff18a39ba173610a0d9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.733182 10747 raft_consensus.cc:729] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.733530 10747 consensus_queue.cc:260] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.733840 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet b0023759f681412c9efe6a68e6a76800 with delete_type TABLET_DATA_DELETED (replaced by tablet e356de6dc72f44c7b96b059ea792bdd0) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.735208 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 2b47a6aee0b74ff18a39ba173610a0d9 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.735895 10747 ts_tablet_manager.cc:1428] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 04:54:33.736445 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet f43280241c7d44179332297f12fef510 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:33.738590 10747 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
W20260925 04:54:33.739279 10580 catalog_manager.cc:4808] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet f43280241c7d44179332297f12fef510 because the tablet was not found. No further retry: Not found: Tablet not found: f43280241c7d44179332297f12fef510
I20260925 04:54:33.741994 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet b0023759f681412c9efe6a68e6a76800 with delete_type TABLET_DATA_DELETED (replaced by tablet e356de6dc72f44c7b96b059ea792bdd0) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.742311 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet b0023759f681412c9efe6a68e6a76800 with delete_type TABLET_DATA_DELETED (replaced by tablet e356de6dc72f44c7b96b059ea792bdd0) from {username='slave'} at 127.0.0.1:49620
W20260925 04:54:33.742978 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet b0023759f681412c9efe6a68e6a76800 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0023759f681412c9efe6a68e6a76800 already in progress: creating tablet
I20260925 04:54:33.743108 10743 tablet_bootstrap.cc:492] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.743273 10743 ts_tablet_manager.cc:1397] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.122s user 0.000s sys 0.003s
I20260925 04:54:33.744011 10743 raft_consensus.cc:348] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.744232 10743 raft_consensus.cc:374] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.744323 10743 raft_consensus.cc:729] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.744772 10743 consensus_queue.cc:260] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.745106 10744 ts_tablet_manager.cc:1905] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.747561 10743 ts_tablet_manager.cc:1428] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 04:54:33.750211 10397 tablet_service.cc:1467] Processing CreateTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.750689 10262 tablet_service.cc:1467] Processing CreateTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.751058 10124 tablet_service.cc:1467] Processing CreateTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.751547 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e356de6dc72f44c7b96b059ea792bdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.751894 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet b0023759f681412c9efe6a68e6a76800 with delete_type TABLET_DATA_DELETED (replaced by tablet e356de6dc72f44c7b96b059ea792bdd0) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.752266 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e356de6dc72f44c7b96b059ea792bdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.753428 10747 tablet_bootstrap.cc:654] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.753556 10746 tablet_replica.cc:330] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.753818 10746 raft_consensus.cc:2229] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.754007 10746 raft_consensus.cc:2258] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.754341 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e356de6dc72f44c7b96b059ea792bdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.752398 10741 tablet_replica.cc:330] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.754843 10741 raft_consensus.cc:2229] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.755056 10741 raft_consensus.cc:2258] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.755856 10741 ts_tablet_manager.cc:1905] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.757483 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 35144ffd80494e38889efc31371f093a from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.762998 10746 ts_tablet_manager.cc:1905] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.752192 10744 ts_tablet_manager.cc:1918] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.763319 10744 log.cc:1196] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/7d5ef41c8f954157837991c18e486201
I20260925 04:54:33.763779 10744 ts_tablet_manager.cc:1939] T 7d5ef41c8f954157837991c18e486201 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.765656 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 35144ffd80494e38889efc31371f093a
I20260925 04:54:33.766191 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 35144ffd80494e38889efc31371f093a deleted and replaced by tablet 4cd4175588994e89ab64ea67e86bd82d
I20260925 04:54:33.767185 10744 tablet_replica.cc:330] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.767973 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.768489 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 7d5ef41c8f954157837991c18e486201 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.769721 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.770421 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.770622 10744 raft_consensus.cc:2229] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.774082 10744 raft_consensus.cc:2258] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.775664 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4175588994e89ab64ea67e86bd82d (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.775991 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4175588994e89ab64ea67e86bd82d (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.776418 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4175588994e89ab64ea67e86bd82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.776551 10744 ts_tablet_manager.cc:1905] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.777240 10747 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.777491 10747 ts_tablet_manager.cc:1397] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.005s
I20260925 04:54:33.778349 10747 raft_consensus.cc:348] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.778712 10747 raft_consensus.cc:374] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.778864 10747 raft_consensus.cc:729] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.779183 10747 consensus_queue.cc:260] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.780026 10747 ts_tablet_manager.cc:1428] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:33.780438 10747 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.785619 10747 tablet_bootstrap.cc:654] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.786485 10745 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.786736 10745 ts_tablet_manager.cc:1397] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.012s
I20260925 04:54:33.787516 10745 raft_consensus.cc:348] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.787902 10745 raft_consensus.cc:374] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.788039 10745 raft_consensus.cc:729] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.788339 10745 consensus_queue.cc:260] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.789114 10745 ts_tablet_manager.cc:1428] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:33.790086 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4175588994e89ab64ea67e86bd82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.790488 10745 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.792687 10745 tablet_bootstrap.cc:654] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.794514 10744 ts_tablet_manager.cc:1918] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.794651 10744 log.cc:1196] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/2b47a6aee0b74ff18a39ba173610a0d9
I20260925 04:54:33.795048 10744 ts_tablet_manager.cc:1939] T 2b47a6aee0b74ff18a39ba173610a0d9 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.795920 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 2b47a6aee0b74ff18a39ba173610a0d9 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.796250 10744 tablet_replica.cc:330] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.796452 10744 raft_consensus.cc:2229] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.796612 10744 raft_consensus.cc:2258] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.797375 10744 ts_tablet_manager.cc:1905] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.804019 10744 ts_tablet_manager.cc:1918] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.804168 10744 log.cc:1196] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/b0023759f681412c9efe6a68e6a76800
I20260925 04:54:33.804569 10744 ts_tablet_manager.cc:1939] T b0023759f681412c9efe6a68e6a76800 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.805580 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet b0023759f681412c9efe6a68e6a76800 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
W20260925 04:54:33.806288 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 35144ffd80494e38889efc31371f093a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35144ffd80494e38889efc31371f093a already in progress: creating tablet
I20260925 04:54:33.813580 10743 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.815017 10746 ts_tablet_manager.cc:1918] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.815181 10746 log.cc:1196] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/7d5ef41c8f954157837991c18e486201
I20260925 04:54:33.816119 10746 ts_tablet_manager.cc:1939] T 7d5ef41c8f954157837991c18e486201 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.816939 10747 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.817143 10747 ts_tablet_manager.cc:1397] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260925 04:54:33.817246 10746 tablet_replica.cc:330] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.817310 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 7d5ef41c8f954157837991c18e486201 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:33.817440 10746 raft_consensus.cc:2229] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.817601 10746 raft_consensus.cc:2258] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.818048 10747 raft_consensus.cc:348] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.818265 10747 raft_consensus.cc:374] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.818356 10747 raft_consensus.cc:729] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.818576 10747 consensus_queue.cc:260] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.818827 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd4175588994e89ab64ea67e86bd82d (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.819057 10747 ts_tablet_manager.cc:1428] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:33.819343 10747 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.819964 10741 ts_tablet_manager.cc:1918] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.820104 10741 log.cc:1196] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/b0023759f681412c9efe6a68e6a76800
I20260925 04:54:33.820503 10741 ts_tablet_manager.cc:1939] T b0023759f681412c9efe6a68e6a76800 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.821411 10746 ts_tablet_manager.cc:1905] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.822155 10743 tablet_bootstrap.cc:654] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.822182 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet b0023759f681412c9efe6a68e6a76800 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
W20260925 04:54:33.822441 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 35144ffd80494e38889efc31371f093a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35144ffd80494e38889efc31371f093a already in progress: creating tablet
I20260925 04:54:33.823755 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cd4175588994e89ab64ea67e86bd82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.826761 10747 tablet_bootstrap.cc:654] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.830927 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--webserver_interface=127.9.81.190
--webserver_port=33381
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:33.832481 10743 tablet_bootstrap.cc:492] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.832706 10743 ts_tablet_manager.cc:1397] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260925 04:54:33.832854 10745 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.833060 10745 ts_tablet_manager.cc:1397] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.043s user 0.011s sys 0.011s
I20260925 04:54:33.833647 10743 raft_consensus.cc:348] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.833950 10743 raft_consensus.cc:374] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.834048 10743 raft_consensus.cc:729] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.833846 10745 raft_consensus.cc:348] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.834213 10745 raft_consensus.cc:374] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.834334 10745 raft_consensus.cc:729] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.834371 10743 consensus_queue.cc:260] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.834666 10745 consensus_queue.cc:260] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.834949 10743 ts_tablet_manager.cc:1428] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:33.835431 10743 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:33.837139 10743 tablet_bootstrap.cc:654] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.837265 10761 raft_consensus.cc:482] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:33.837417 10761 raft_consensus.cc:504] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.839613 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6975bf0c943455188a956bf9d2970bd" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:33.840013 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:54288
W20260925 04:54:33.840327 10077 leader_election.cc:341] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:33.840214 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6975bf0c943455188a956bf9d2970bd" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:33.840505 10417 raft_consensus.cc:2454] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
W20260925 04:54:33.840618 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 35144ffd80494e38889efc31371f093a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35144ffd80494e38889efc31371f093a already in progress: creating tablet
I20260925 04:54:33.840981 10746 ts_tablet_manager.cc:1918] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.841135 10746 log.cc:1196] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/2b47a6aee0b74ff18a39ba173610a0d9
I20260925 04:54:33.838020 10761 leader_election.cc:288] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.841522 10746 ts_tablet_manager.cc:1939] T 2b47a6aee0b74ff18a39ba173610a0d9 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.841817 10078 leader_election.cc:302] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:33.842407 10746 tablet_replica.cc:330] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.842552 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 2b47a6aee0b74ff18a39ba173610a0d9 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.842602 10746 raft_consensus.cc:2229] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.842885 10761 raft_consensus.cc:2781] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:33.842993 10761 raft_consensus.cc:482] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:33.843116 10761 raft_consensus.cc:3037] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.845844 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 35144ffd80494e38889efc31371f093a from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.848755 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 4cd4175588994e89ab64ea67e86bd82d from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.852046 10761 raft_consensus.cc:504] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.852686 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet b6975bf0c943455188a956bf9d2970bd from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.852973 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6975bf0c943455188a956bf9d2970bd" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:33.853255 10417 raft_consensus.cc:3037] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.855921 10417 raft_consensus.cc:2454] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:33.856438 10078 leader_election.cc:302] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:33.856782 10722 raft_consensus.cc:2781] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:33.856946 10722 raft_consensus.cc:686] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:33.842747 10746 raft_consensus.cc:2258] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.857283 10722 consensus_queue.cc:237] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.858453 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d5ef41c8f954157837991c18e486201 with delete_type TABLET_DATA_DELETED (replaced by tablet fca5ab47510b47408fcad1b94eba0945) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.858781 10761 leader_election.cc:288] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.858999 10741 tablet_replica.cc:330] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.859202 10741 raft_consensus.cc:2229] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.859287 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6975bf0c943455188a956bf9d2970bd" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:33.859369 10741 raft_consensus.cc:2258] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.859887 10745 ts_tablet_manager.cc:1428] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
W20260925 04:54:33.859903 10077 leader_election.cc:341] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:33.860733 10741 ts_tablet_manager.cc:1905] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.863945 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 4cd4175588994e89ab64ea67e86bd82d
I20260925 04:54:33.864440 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 4cd4175588994e89ab64ea67e86bd82d deleted and replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516
I20260925 04:54:33.866019 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4175588994e89ab64ea67e86bd82d with delete_type TABLET_DATA_DELETED (replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.866247 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.866771 10745 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.868216 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4175588994e89ab64ea67e86bd82d with delete_type TABLET_DATA_DELETED (replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.868328 10745 tablet_bootstrap.cc:654] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.868925 10744 tablet_replica.cc:330] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.869123 10744 raft_consensus.cc:2229] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.869292 10744 raft_consensus.cc:2258] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 04:54:33.869695 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 4cd4175588994e89ab64ea67e86bd82d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd4175588994e89ab64ea67e86bd82d already in progress: creating tablet
I20260925 04:54:33.869982 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4175588994e89ab64ea67e86bd82d with delete_type TABLET_DATA_DELETED (replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.870929 10744 ts_tablet_manager.cc:1905] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.873835 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet b6975bf0c943455188a956bf9d2970bd
I20260925 04:54:33.874256 10585 catalog_manager.cc:6565] ReplaceTablet: tablet b6975bf0c943455188a956bf9d2970bd deleted and replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb
I20260925 04:54:33.874622 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet b6975bf0c943455188a956bf9d2970bd with delete_type TABLET_DATA_DELETED (replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.877092 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet b6975bf0c943455188a956bf9d2970bd with delete_type TABLET_DATA_DELETED (replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.879206 10744 ts_tablet_manager.cc:1918] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.879326 10744 log.cc:1196] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/35144ffd80494e38889efc31371f093a
I20260925 04:54:33.880051 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet b6975bf0c943455188a956bf9d2970bd with delete_type TABLET_DATA_DELETED (replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.880474 10744 ts_tablet_manager.cc:1939] T 35144ffd80494e38889efc31371f093a P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:33.880950 10746 ts_tablet_manager.cc:1905] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.882611 10741 ts_tablet_manager.cc:1918] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.882766 10741 log.cc:1196] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/7d5ef41c8f954157837991c18e486201
I20260925 04:54:33.883129 10741 ts_tablet_manager.cc:1939] T 7d5ef41c8f954157837991c18e486201 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.884778 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 35144ffd80494e38889efc31371f093a (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.885154 10744 tablet_replica.cc:330] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:33.884902 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.885396 10744 raft_consensus.cc:2229] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.885628 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9575bb4bffdc4ff6ad5cd40526739516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.886381 10745 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.886543 10745 ts_tablet_manager.cc:1397] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260925 04:54:33.886587 10744 raft_consensus.cc:2258] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.887385 10745 raft_consensus.cc:348] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.887635 10745 raft_consensus.cc:374] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.887715 10745 raft_consensus.cc:729] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.887965 10745 consensus_queue.cc:260] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.890239 10747 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.890417 10747 ts_tablet_manager.cc:1397] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.008s
I20260925 04:54:33.890340 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.890764 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9575bb4bffdc4ff6ad5cd40526739516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.891144 10747 raft_consensus.cc:348] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.891378 10747 raft_consensus.cc:374] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.891446 10747 raft_consensus.cc:729] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.891711 10747 consensus_queue.cc:260] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.892501 10747 ts_tablet_manager.cc:1428] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:33.893548 10747 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.893807 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 7d5ef41c8f954157837991c18e486201 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
W20260925 04:54:33.894083 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 4cd4175588994e89ab64ea67e86bd82d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd4175588994e89ab64ea67e86bd82d already in progress: creating tablet
W20260925 04:54:33.894300 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet b6975bf0c943455188a956bf9d2970bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6975bf0c943455188a956bf9d2970bd already in progress: creating tablet
I20260925 04:54:33.895077 10747 tablet_bootstrap.cc:654] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.896560 10745 ts_tablet_manager.cc:1428] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 04:54:33.899554 10745 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.901372 10745 tablet_bootstrap.cc:654] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.907012 10746 ts_tablet_manager.cc:1918] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.907235 10746 log.cc:1196] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/b0023759f681412c9efe6a68e6a76800
I20260925 04:54:33.907662 10746 ts_tablet_manager.cc:1939] T b0023759f681412c9efe6a68e6a76800 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.908740 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet b0023759f681412c9efe6a68e6a76800 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:33.909123 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.910369 10746 tablet_replica.cc:330] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.910555 10746 raft_consensus.cc:2229] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.910722 10746 raft_consensus.cc:2258] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.911485 10746 ts_tablet_manager.cc:1905] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.911715 10747 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.911859 10747 ts_tablet_manager.cc:1397] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.007s
I20260925 04:54:33.912686 10747 raft_consensus.cc:348] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.912925 10747 raft_consensus.cc:374] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.913048 10747 raft_consensus.cc:729] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.913298 10747 consensus_queue.cc:260] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.914708 10747 ts_tablet_manager.cc:1428] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:33.914996 10747 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.916786 10747 tablet_bootstrap.cc:654] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:33.917906 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.918330 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5c13fc38f042268a0b7f7399a3c2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.918691 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9575bb4bffdc4ff6ad5cd40526739516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.921458 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.921953 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5c13fc38f042268a0b7f7399a3c2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.922812 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.923169 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f5c13fc38f042268a0b7f7399a3c2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.923926 10744 ts_tablet_manager.cc:1905] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.929807 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet e59a45c74ec54b53bfc86c386bb15d19 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.923950 10745 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:33.934451 10745 ts_tablet_manager.cc:1397] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.001s
I20260925 04:54:33.937459 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:33.938715 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 with delete_type TABLET_DATA_DELETED (replaced by tablet c123a26dd438443093ea8b3e63120ebb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:33.939025 10584 catalog_manager.cc:6565] ReplaceTablet: tablet e59a45c74ec54b53bfc86c386bb15d19 deleted and replaced by tablet c123a26dd438443093ea8b3e63120ebb
I20260925 04:54:33.939071 10741 tablet_replica.cc:330] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:33.939253 10741 raft_consensus.cc:2229] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.939450 10741 raft_consensus.cc:2258] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.940169 10741 ts_tablet_manager.cc:1905] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.944569 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 with delete_type TABLET_DATA_DELETED (replaced by tablet c123a26dd438443093ea8b3e63120ebb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.944654 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet e59a45c74ec54b53bfc86c386bb15d19 with delete_type TABLET_DATA_DELETED (replaced by tablet c123a26dd438443093ea8b3e63120ebb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:33.947329 10741 ts_tablet_manager.cc:1918] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.947590 10741 log.cc:1196] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:33.948411 10741 ts_tablet_manager.cc:1939] T e59a45c74ec54b53bfc86c386bb15d19 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:33.949513 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e59a45c74ec54b53bfc86c386bb15d19 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:33.952783 10124 tablet_service.cc:1467] Processing CreateTablet for tablet c123a26dd438443093ea8b3e63120ebb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.953541 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c123a26dd438443093ea8b3e63120ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.955857 10746 ts_tablet_manager.cc:1918] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.955992 10746 log.cc:1196] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/35144ffd80494e38889efc31371f093a
I20260925 04:54:33.956374 10746 ts_tablet_manager.cc:1939] T 35144ffd80494e38889efc31371f093a P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:33.957201 10728 raft_consensus.cc:482] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:33.957358 10728 raft_consensus.cc:504] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.957717 10746 tablet_replica.cc:330] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:33.957907 10746 raft_consensus.cc:2229] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:33.957952 10728 leader_election.cc:288] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.958063 10746 raft_consensus.cc:2258] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:33.958824 10746 ts_tablet_manager.cc:1905] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:33.958868 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59a45c74ec54b53bfc86c386bb15d19" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:33.959105 10144 raft_consensus.cc:2454] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:33.959758 10353 leader_election.cc:302] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
W20260925 04:54:33.960191 10351 leader_election.cc:341] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:33.960732 10728 raft_consensus.cc:2781] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:33.960835 10728 raft_consensus.cc:482] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:33.960919 10728 raft_consensus.cc:3037] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.961961 10747 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:33.962143 10747 ts_tablet_manager.cc:1397] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.013s
I20260925 04:54:33.963546 10728 raft_consensus.cc:504] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
W20260925 04:54:33.965205 10351 leader_election.cc:341] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:33.965412 10728 leader_election.cc:288] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:33.965691 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 35144ffd80494e38889efc31371f093a (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:33.966908 10395 tablet_service.cc:1467] Processing CreateTablet for tablet c123a26dd438443093ea8b3e63120ebb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.967283 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c123a26dd438443093ea8b3e63120ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.972940 10747 raft_consensus.cc:348] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.973218 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e59a45c74ec54b53bfc86c386bb15d19" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:33.973685 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet b6975bf0c943455188a956bf9d2970bd from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:33.975523 10262 tablet_service.cc:1467] Processing CreateTablet for tablet c123a26dd438443093ea8b3e63120ebb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:33.975960 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c123a26dd438443093ea8b3e63120ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:33.981160 10144 raft_consensus.cc:3037] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:33.981117 10747 raft_consensus.cc:374] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.984509 10745 raft_consensus.cc:348] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.984817 10745 raft_consensus.cc:374] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:33.984974 10745 raft_consensus.cc:729] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.985631 10745 consensus_queue.cc:260] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.988916 10747 raft_consensus.cc:729] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:33.989605 10747 consensus_queue.cc:260] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:33.990144 10144 raft_consensus.cc:2454] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:33.990231 10747 ts_tablet_manager.cc:1428] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260925 04:54:33.991639 10743 tablet_bootstrap.cc:492] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:33.987131 10745 ts_tablet_manager.cc:1428] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.053s user 0.000s sys 0.002s
I20260925 04:54:33.992062 10745 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:33.992554 10746 ts_tablet_manager.cc:1918] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:33.991230 10353 leader_election.cc:302] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:33.992805 10743 ts_tablet_manager.cc:1397] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.157s user 0.007s sys 0.000s
I20260925 04:54:33.995025 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4175588994e89ab64ea67e86bd82d with delete_type TABLET_DATA_DELETED (replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:33.997092 10747 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:33.997574 10728 raft_consensus.cc:2781] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:33.999275 10746 log.cc:1196] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/4cd4175588994e89ab64ea67e86bd82d
I20260925 04:54:33.996819 10743 raft_consensus.cc:348] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.000241 10743 raft_consensus.cc:374] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.000361 10743 raft_consensus.cc:729] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.001371 10745 tablet_bootstrap.cc:654] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.001900 10743 consensus_queue.cc:260] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.002084 10746 ts_tablet_manager.cc:1939] T 4cd4175588994e89ab64ea67e86bd82d P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.004825 10747 tablet_bootstrap.cc:654] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.005241 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet b6975bf0c943455188a956bf9d2970bd with delete_type TABLET_DATA_DELETED (replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.005576 10746 tablet_replica.cc:330] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.005764 10746 raft_consensus.cc:2229] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
W20260925 04:54:34.005880 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet b6975bf0c943455188a956bf9d2970bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6975bf0c943455188a956bf9d2970bd already in progress: creating tablet
I20260925 04:54:34.006021 10746 pending_rounds.cc:62] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:34.006083 10746 pending_rounds.cc:68] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118254522171392 op_type: NO_OP noop_request { }
I20260925 04:54:34.006219 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 4cd4175588994e89ab64ea67e86bd82d (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.007958 10744 ts_tablet_manager.cc:1918] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.008114 10744 log.cc:1196] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/b6975bf0c943455188a956bf9d2970bd
I20260925 04:54:34.008443 10744 ts_tablet_manager.cc:1939] T b6975bf0c943455188a956bf9d2970bd P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.006251 10746 raft_consensus.cc:2866] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:34.009229 10746 raft_consensus.cc:2258] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.009652 10728 raft_consensus.cc:686] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:34.009981 10728 consensus_queue.cc:237] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.010444 10743 ts_tablet_manager.cc:1428] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260925 04:54:34.010792 10743 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.013568 10746 ts_tablet_manager.cc:1905] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.019634 10746 ts_tablet_manager.cc:1918] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:34.020301 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet b6975bf0c943455188a956bf9d2970bd with delete_type TABLET_DATA_DELETED (replaced by tablet 7f5c13fc38f042268a0b7f7399a3c2eb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.020892 10746 log.cc:1196] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/b6975bf0c943455188a956bf9d2970bd
I20260925 04:54:34.021421 10741 tablet_replica.cc:330] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.021682 10741 raft_consensus.cc:2229] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.021751 10744 tablet_replica.cc:330] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.021872 10741 raft_consensus.cc:2258] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.022850 10741 ts_tablet_manager.cc:1905] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.022990 10747 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.023135 10747 ts_tablet_manager.cc:1397] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.003s
I20260925 04:54:34.022987 10746 ts_tablet_manager.cc:1939] T b6975bf0c943455188a956bf9d2970bd P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.023895 10747 raft_consensus.cc:348] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.024746 10747 raft_consensus.cc:374] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.024838 10747 raft_consensus.cc:729] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.025048 10746 tablet_replica.cc:330] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.025188 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet b6975bf0c943455188a956bf9d2970bd (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.025249 10746 raft_consensus.cc:2229] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.025110 10747 consensus_queue.cc:260] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.025415 10746 raft_consensus.cc:2258] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.029034 10746 ts_tablet_manager.cc:1905] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.025805 10747 ts_tablet_manager.cc:1428] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 04:54:34.029871 10744 raft_consensus.cc:2229] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:34.030915 10741 ts_tablet_manager.cc:1918] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.031075 10744 pending_rounds.cc:62] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Trying to abort 1 pending ops.
I20260925 04:54:34.031108 10741 log.cc:1196] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/b6975bf0c943455188a956bf9d2970bd
I20260925 04:54:34.031236 10744 pending_rounds.cc:68] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118255147687936 op_type: NO_OP noop_request { }
I20260925 04:54:34.031489 10741 ts_tablet_manager.cc:1939] T b6975bf0c943455188a956bf9d2970bd P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.031467 10744 raft_consensus.cc:2866] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:34.031641 10744 raft_consensus.cc:2258] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.032505 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet b6975bf0c943455188a956bf9d2970bd (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.032682 10744 ts_tablet_manager.cc:1905] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.032974 10747 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.036141 10747 tablet_bootstrap.cc:654] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.037547 10745 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.037729 10745 ts_tablet_manager.cc:1397] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.003s
I20260925 04:54:34.038789 10744 ts_tablet_manager.cc:1918] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:34.038945 10744 log.cc:1196] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:34.039227 10745 raft_consensus.cc:348] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.039490 10745 raft_consensus.cc:374] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.039597 10745 raft_consensus.cc:729] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.039849 10745 consensus_queue.cc:260] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.040372 10745 ts_tablet_manager.cc:1428] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:34.041208 10743 tablet_bootstrap.cc:654] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.041826 10746 ts_tablet_manager.cc:1918] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.041944 10746 log.cc:1196] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e59a45c74ec54b53bfc86c386bb15d19
I20260925 04:54:34.042373 10746 ts_tablet_manager.cc:1939] T e59a45c74ec54b53bfc86c386bb15d19 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.043557 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e59a45c74ec54b53bfc86c386bb15d19 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.045532 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet b6975bf0c943455188a956bf9d2970bd (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.045660 10747 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.045816 10747 ts_tablet_manager.cc:1397] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260925 04:54:34.046478 10745 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.046517 10747 raft_consensus.cc:348] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.046720 10747 raft_consensus.cc:374] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.046787 10747 raft_consensus.cc:729] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.039387 10744 ts_tablet_manager.cc:1939] T e59a45c74ec54b53bfc86c386bb15d19 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.047034 10747 consensus_queue.cc:260] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.049319 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e59a45c74ec54b53bfc86c386bb15d19 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.051002 10747 ts_tablet_manager.cc:1428] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 04:54:34.051342 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 9575bb4bffdc4ff6ad5cd40526739516 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.052208 10745 tablet_bootstrap.cc:654] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.053855 10744 tablet_replica.cc:330] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.054033 10744 raft_consensus.cc:2229] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.054219 10744 raft_consensus.cc:2258] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.055366 10744 ts_tablet_manager.cc:1905] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.057678 10743 tablet_bootstrap.cc:492] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.057847 10743 ts_tablet_manager.cc:1397] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.003s
I20260925 04:54:34.058272 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 9575bb4bffdc4ff6ad5cd40526739516
I20260925 04:54:34.058468 10743 raft_consensus.cc:348] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.058807 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 9575bb4bffdc4ff6ad5cd40526739516 deleted and replaced by tablet 1de6336c7812448a90d751a46809b643
I20260925 04:54:34.058965 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 with delete_type TABLET_DATA_DELETED (replaced by tablet 1de6336c7812448a90d751a46809b643) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.059449 10746 tablet_replica.cc:330] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.059684 10746 raft_consensus.cc:2229] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.059923 10746 raft_consensus.cc:2258] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.060570 10746 ts_tablet_manager.cc:1905] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.061743 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 with delete_type TABLET_DATA_DELETED (replaced by tablet 1de6336c7812448a90d751a46809b643) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.061605 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 with delete_type TABLET_DATA_DELETED (replaced by tablet 1de6336c7812448a90d751a46809b643) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.067776 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6336c7812448a90d751a46809b643 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.068158 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6336c7812448a90d751a46809b643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.068310 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f5c13fc38f042268a0b7f7399a3c2eb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.069365 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6336c7812448a90d751a46809b643 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.069779 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6336c7812448a90d751a46809b643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.072252 10746 ts_tablet_manager.cc:1918] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.072376 10746 log.cc:1196] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/9575bb4bffdc4ff6ad5cd40526739516
I20260925 04:54:34.072700 10746 ts_tablet_manager.cc:1939] T 9575bb4bffdc4ff6ad5cd40526739516 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.073793 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6336c7812448a90d751a46809b643 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.074172 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6336c7812448a90d751a46809b643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.080173 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet c123a26dd438443093ea8b3e63120ebb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.081435 10747 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.083016 10747 tablet_bootstrap.cc:654] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.084074 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 7f5c13fc38f042268a0b7f7399a3c2eb
I20260925 04:54:34.084547 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 7f5c13fc38f042268a0b7f7399a3c2eb deleted and replaced by tablet e76b0952a818425985a65da4b529b249
I20260925 04:54:34.085613 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb with delete_type TABLET_DATA_DELETED (replaced by tablet e76b0952a818425985a65da4b529b249) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.085966 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb with delete_type TABLET_DATA_DELETED (replaced by tablet e76b0952a818425985a65da4b529b249) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.086953 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb with delete_type TABLET_DATA_DELETED (replaced by tablet e76b0952a818425985a65da4b529b249) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.089740 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 9575bb4bffdc4ff6ad5cd40526739516 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.090075 10746 tablet_replica.cc:330] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.090648 10746 raft_consensus.cc:2229] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.091084 10746 raft_consensus.cc:2258] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 04:54:34.091900 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 9575bb4bffdc4ff6ad5cd40526739516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9575bb4bffdc4ff6ad5cd40526739516 already in progress: creating tablet
W20260925 04:54:34.092231 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 7f5c13fc38f042268a0b7f7399a3c2eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f5c13fc38f042268a0b7f7399a3c2eb already in progress: creating tablet
I20260925 04:54:34.094861 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet c123a26dd438443093ea8b3e63120ebb
I20260925 04:54:34.095356 10585 catalog_manager.cc:6565] ReplaceTablet: tablet c123a26dd438443093ea8b3e63120ebb deleted and replaced by tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3
I20260925 04:54:34.096642 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet c123a26dd438443093ea8b3e63120ebb with delete_type TABLET_DATA_DELETED (replaced by tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.097450 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet c123a26dd438443093ea8b3e63120ebb with delete_type TABLET_DATA_DELETED (replaced by tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.098253 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet c123a26dd438443093ea8b3e63120ebb with delete_type TABLET_DATA_DELETED (replaced by tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.100785 10746 ts_tablet_manager.cc:1905] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 04:54:34.102170 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet c123a26dd438443093ea8b3e63120ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c123a26dd438443093ea8b3e63120ebb already in progress: creating tablet
I20260925 04:54:34.104157 10747 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.104359 10747 ts_tablet_manager.cc:1397] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.005s
I20260925 04:54:34.105590 10747 raft_consensus.cc:348] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.105903 10747 raft_consensus.cc:374] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.106038 10747 raft_consensus.cc:729] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.106443 10747 consensus_queue.cc:260] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.109076 10746 ts_tablet_manager.cc:1918] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.109218 10746 log.cc:1196] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/7f5c13fc38f042268a0b7f7399a3c2eb
I20260925 04:54:34.109616 10746 ts_tablet_manager.cc:1939] T 7f5c13fc38f042268a0b7f7399a3c2eb P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.110042 10747 ts_tablet_manager.cc:1428] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 04:54:34.110510 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 7f5c13fc38f042268a0b7f7399a3c2eb (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.111953 10397 tablet_service.cc:1467] Processing CreateTablet for tablet e76b0952a818425985a65da4b529b249 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.112426 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76b0952a818425985a65da4b529b249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.112527 10746 tablet_replica.cc:330] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.112702 10746 raft_consensus.cc:2229] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.112851 10746 raft_consensus.cc:2258] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.113592 10746 ts_tablet_manager.cc:1905] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.119082 10722 raft_consensus.cc:482] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.119282 10722 raft_consensus.cc:504] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.119722 10124 tablet_service.cc:1467] Processing CreateTablet for tablet e76b0952a818425985a65da4b529b249 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.119874 10722 leader_election.cc:288] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.120095 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76b0952a818425985a65da4b529b249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.120528 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca5ab47510b47408fcad1b94eba0945" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:34.120791 10746 ts_tablet_manager.cc:1918] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.120929 10746 log.cc:1196] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/c123a26dd438443093ea8b3e63120ebb
I20260925 04:54:34.121235 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca5ab47510b47408fcad1b94eba0945" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:34.121357 10746 ts_tablet_manager.cc:1939] T c123a26dd438443093ea8b3e63120ebb P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.121477 10417 raft_consensus.cc:2454] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:34.122341 10078 leader_election.cc:302] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.122645 10722 raft_consensus.cc:2781] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:34.122753 10722 raft_consensus.cc:482] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:34.122853 10722 raft_consensus.cc:3037] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.126482 10747 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.127966 10747 tablet_bootstrap.cc:654] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.130055 10722 raft_consensus.cc:504] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.131460 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca5ab47510b47408fcad1b94eba0945" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:34.131738 10417 raft_consensus.cc:3037] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.135464 10417 raft_consensus.cc:2454] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:34.136093 10078 leader_election.cc:302] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.136350 10761 raft_consensus.cc:2781] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:34.136507 10761 raft_consensus.cc:686] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:34.136538 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet c123a26dd438443093ea8b3e63120ebb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.136765 10761 consensus_queue.cc:237] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.137624 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fca5ab47510b47408fcad1b94eba0945" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:34.138655 10722 leader_election.cc:288] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.143543 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f5c13fc38f042268a0b7f7399a3c2eb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.144631 10747 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.144806 10747 ts_tablet_manager.cc:1397] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.004s
I20260925 04:54:34.145562 10747 raft_consensus.cc:348] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.145843 10747 raft_consensus.cc:374] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.145917 10747 raft_consensus.cc:729] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.146137 10747 consensus_queue.cc:260] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.154716 10747 ts_tablet_manager.cc:1428] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260925 04:54:34.158991 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.159442 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.161958 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.162374 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.166956 10585 catalog_manager.cc:5495] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 270ea27d66a1425eae85f73563e04c00 (127.9.81.129). New cstate: current_term: 1 leader_uuid: "270ea27d66a1425eae85f73563e04c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:34.169205 10747 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.170809 10747 tablet_bootstrap.cc:654] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.171223 10260 tablet_service.cc:1467] Processing CreateTablet for tablet e76b0952a818425985a65da4b529b249 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.171677 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76b0952a818425985a65da4b529b249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.178395 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet c123a26dd438443093ea8b3e63120ebb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.179201 10747 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.179349 10747 ts_tablet_manager.cc:1397] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260925 04:54:34.180063 10747 raft_consensus.cc:348] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.180318 10747 raft_consensus.cc:374] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.180423 10747 raft_consensus.cc:729] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.180615 10747 consensus_queue.cc:260] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.183645 10747 ts_tablet_manager.cc:1428] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 04:54:34.184505 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.185163 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.058701 10743 raft_consensus.cc:374] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.188314 10743 raft_consensus.cc:729] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.188702 10743 consensus_queue.cc:260] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.189126 10282 raft_consensus.cc:2454] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:34.192926 10743 ts_tablet_manager.cc:1428] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.135s user 0.000s sys 0.003s
I20260925 04:54:34.193704 10743 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.201071 10743 tablet_bootstrap.cc:654] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.208150 10590 catalog_manager.cc:3411] renamed table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748] in HMS: new name default.table_6c52826d192a4ccda763b30ee29815ad
I20260925 04:54:34.210561 10744 ts_tablet_manager.cc:1918] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.210724 10744 log.cc:1196] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/4cd4175588994e89ab64ea67e86bd82d
I20260925 04:54:34.211045 10744 ts_tablet_manager.cc:1939] T 4cd4175588994e89ab64ea67e86bd82d P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.212002 10744 tablet_replica.cc:330] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.212141 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 4cd4175588994e89ab64ea67e86bd82d (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.215401 10745 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.215540 10745 ts_tablet_manager.cc:1397] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.169s user 0.002s sys 0.001s
I20260925 04:54:34.216265 10745 raft_consensus.cc:348] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.216485 10745 raft_consensus.cc:374] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.216562 10745 raft_consensus.cc:729] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.216770 10745 consensus_queue.cc:260] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.217326 10745 ts_tablet_manager.cc:1428] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:34.217645 10745 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.219722 10745 tablet_bootstrap.cc:654] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.221163 10744 raft_consensus.cc:2229] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.221405 10744 raft_consensus.cc:2258] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.222880 10743 tablet_bootstrap.cc:492] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.223047 10743 ts_tablet_manager.cc:1397] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20260925 04:54:34.223980 10743 raft_consensus.cc:348] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.224224 10743 raft_consensus.cc:374] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.224340 10743 raft_consensus.cc:729] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.224625 10743 consensus_queue.cc:260] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.228093 10743 ts_tablet_manager.cc:1428] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260925 04:54:34.228726 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 35144ffd80494e38889efc31371f093a with delete_type TABLET_DATA_DELETED (replaced by tablet 4cd4175588994e89ab64ea67e86bd82d) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.229171 10741 tablet_replica.cc:330] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.229458 10741 raft_consensus.cc:2229] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.229737 10741 raft_consensus.cc:2258] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.230902 10741 ts_tablet_manager.cc:1905] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.234133 10744 ts_tablet_manager.cc:1905] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.238268 10741 ts_tablet_manager.cc:1918] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.238437 10741 log.cc:1196] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/35144ffd80494e38889efc31371f093a
I20260925 04:54:34.239173 10743 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.240762 10743 tablet_bootstrap.cc:654] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.238802 10741 ts_tablet_manager.cc:1939] T 35144ffd80494e38889efc31371f093a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.242494 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 35144ffd80494e38889efc31371f093a (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.245494 10744 ts_tablet_manager.cc:1918] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.245743 10744 log.cc:1196] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/9575bb4bffdc4ff6ad5cd40526739516
I20260925 04:54:34.246342 10744 ts_tablet_manager.cc:1939] T 9575bb4bffdc4ff6ad5cd40526739516 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.247908 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 9575bb4bffdc4ff6ad5cd40526739516 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.248661 10744 tablet_replica.cc:330] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.248908 10744 raft_consensus.cc:2229] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.249171 10744 raft_consensus.cc:2258] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.249586 10745 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.249792 10745 ts_tablet_manager.cc:1397] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.020s
I20260925 04:54:34.250058 10744 ts_tablet_manager.cc:1905] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.250168 10743 tablet_bootstrap.cc:492] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.250345 10743 ts_tablet_manager.cc:1397] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260925 04:54:34.250694 10745 raft_consensus.cc:348] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.251003 10745 raft_consensus.cc:374] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.251116 10745 raft_consensus.cc:729] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.251031 10743 raft_consensus.cc:348] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.251374 10743 raft_consensus.cc:374] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.251471 10743 raft_consensus.cc:729] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.251434 10745 consensus_queue.cc:260] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.251724 10743 consensus_queue.cc:260] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.255307 10745 ts_tablet_manager.cc:1428] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 04:54:34.256763 10745 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.257486 10744 ts_tablet_manager.cc:1918] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.257640 10744 log.cc:1196] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/7f5c13fc38f042268a0b7f7399a3c2eb
I20260925 04:54:34.258169 10744 ts_tablet_manager.cc:1939] T 7f5c13fc38f042268a0b7f7399a3c2eb P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.259248 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 7f5c13fc38f042268a0b7f7399a3c2eb (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.259317 10744 tablet_replica.cc:330] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.259553 10744 raft_consensus.cc:2229] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.259735 10744 raft_consensus.cc:2258] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.260483 10744 ts_tablet_manager.cc:1905] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.260923 10743 ts_tablet_manager.cc:1428] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260925 04:54:34.263260 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f5c13fc38f042268a0b7f7399a3c2eb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.263638 10743 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.265666 10743 tablet_bootstrap.cc:654] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.267756 10745 tablet_bootstrap.cc:654] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.268380 10744 ts_tablet_manager.cc:1918] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.268577 10744 log.cc:1196] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/c123a26dd438443093ea8b3e63120ebb
I20260925 04:54:34.269160 10744 ts_tablet_manager.cc:1939] T c123a26dd438443093ea8b3e63120ebb P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.270891 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet c123a26dd438443093ea8b3e63120ebb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.272010 10745 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.272181 10745 ts_tablet_manager.cc:1397] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260925 04:54:34.273108 10745 raft_consensus.cc:348] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.273387 10745 raft_consensus.cc:374] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.273494 10745 raft_consensus.cc:729] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.273838 10745 consensus_queue.cc:260] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.277626 10745 ts_tablet_manager.cc:1428] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 04:54:34.279038 10745 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.281909 10743 tablet_bootstrap.cc:492] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.282109 10743 ts_tablet_manager.cc:1397] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260925 04:54:34.282825 10745 tablet_bootstrap.cc:654] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.282934 10743 raft_consensus.cc:348] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.283217 10743 raft_consensus.cc:374] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.283345 10743 raft_consensus.cc:729] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.283608 10743 consensus_queue.cc:260] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.284211 10743 ts_tablet_manager.cc:1428] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:34.284538 10743 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.286166 10743 tablet_bootstrap.cc:654] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.287739 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd4175588994e89ab64ea67e86bd82d with delete_type TABLET_DATA_DELETED (replaced by tablet 9575bb4bffdc4ff6ad5cd40526739516) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.288318 10741 tablet_replica.cc:330] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.288587 10741 raft_consensus.cc:2229] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.288779 10741 raft_consensus.cc:2258] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.290894 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f5c13fc38f042268a0b7f7399a3c2eb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.291085 10741 ts_tablet_manager.cc:1905] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.296936 10741 ts_tablet_manager.cc:1918] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.297339 10741 log.cc:1196] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/4cd4175588994e89ab64ea67e86bd82d
I20260925 04:54:34.297734 10741 ts_tablet_manager.cc:1939] T 4cd4175588994e89ab64ea67e86bd82d P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.298611 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 4cd4175588994e89ab64ea67e86bd82d (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.299613 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet c123a26dd438443093ea8b3e63120ebb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.313359 10745 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.313562 10745 ts_tablet_manager.cc:1397] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.006s
I20260925 04:54:34.314404 10745 raft_consensus.cc:348] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.314725 10745 raft_consensus.cc:374] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.314821 10745 raft_consensus.cc:729] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.315109 10745 consensus_queue.cc:260] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.316249 10745 ts_tablet_manager.cc:1428] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:34.316540 10745 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.318147 10745 tablet_bootstrap.cc:654] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.328910 10745 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.329087 10745 ts_tablet_manager.cc:1397] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.004s
I20260925 04:54:34.329840 10745 raft_consensus.cc:348] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.330044 10745 raft_consensus.cc:374] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.330116 10745 raft_consensus.cc:729] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.330338 10745 consensus_queue.cc:260] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.335054 10745 ts_tablet_manager.cc:1428] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 04:54:34.347512 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.348681 10743 tablet_bootstrap.cc:492] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.348960 10743 ts_tablet_manager.cc:1397] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.004s
I20260925 04:54:34.350044 10743 raft_consensus.cc:348] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.350448 10743 raft_consensus.cc:374] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.350600 10743 raft_consensus.cc:729] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.351001 10743 consensus_queue.cc:260] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.353577 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3
I20260925 04:54:34.353962 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 deleted and replaced by tablet 40d4745699fa46c485ae7207ced0f25b
I20260925 04:54:34.354816 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d4745699fa46c485ae7207ced0f25b) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.355312 10743 ts_tablet_manager.cc:1428] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260925 04:54:34.355465 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 already in progress: creating tablet
I20260925 04:54:34.357350 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d4745699fa46c485ae7207ced0f25b) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.357601 10744 tablet_replica.cc:330] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.357759 10744 raft_consensus.cc:2229] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.357928 10744 raft_consensus.cc:2258] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.358115 10728 raft_consensus.cc:482] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.358271 10728 raft_consensus.cc:504] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.358937 10728 leader_election.cc:288] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.359390 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:34.359630 10144 raft_consensus.cc:2454] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:34.360023 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d4745699fa46c485ae7207ced0f25b) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.360129 10353 leader_election.cc:302] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.360263 10746 tablet_replica.cc:330] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.360445 10746 raft_consensus.cc:2229] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.360505 10728 raft_consensus.cc:2781] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:34.360623 10746 raft_consensus.cc:2258] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.360622 10728 raft_consensus.cc:482] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:34.360719 10728 raft_consensus.cc:3037] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.361606 10744 ts_tablet_manager.cc:1905] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.363642 10728 raft_consensus.cc:504] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.364677 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:34.364889 10144 raft_consensus.cc:3037] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.364914 10728 leader_election.cc:288] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.365437 10746 ts_tablet_manager.cc:1905] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.367599 10144 raft_consensus.cc:2454] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:34.369143 10353 leader_election.cc:302] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.369266 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:34.369467 10743 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.369834 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:34.371835 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f5c13fc38f042268a0b7f7399a3c2eb with delete_type TABLET_DATA_DELETED (replaced by tablet e76b0952a818425985a65da4b529b249) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.372125 10741 tablet_replica.cc:330] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.372339 10741 raft_consensus.cc:2229] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.372525 10741 raft_consensus.cc:2258] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.373325 10741 ts_tablet_manager.cc:1905] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.377199 10728 raft_consensus.cc:2781] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
W20260925 04:54:34.377233 10351 leader_election.cc:341] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:34.377369 10728 raft_consensus.cc:686] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:34.378896 10743 tablet_bootstrap.cc:654] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.379071 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4745699fa46c485ae7207ced0f25b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.379498 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4745699fa46c485ae7207ced0f25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.383162 10741 ts_tablet_manager.cc:1918] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.383363 10741 log.cc:1196] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/7f5c13fc38f042268a0b7f7399a3c2eb
I20260925 04:54:34.383886 10741 ts_tablet_manager.cc:1939] T 7f5c13fc38f042268a0b7f7399a3c2eb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.385242 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 7f5c13fc38f042268a0b7f7399a3c2eb (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:34.385326 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet e356de6dc72f44c7b96b059ea792bdd0 from {username='slave'} at 127.0.0.1:52548
W20260925 04:54:34.386629 10351 leader_election.cc:341] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:34.387312 10746 ts_tablet_manager.cc:1918] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.387513 10746 log.cc:1196] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/2f90f2bc06f44e80b37e25f0ad0c6ab3
I20260925 04:54:34.387786 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4745699fa46c485ae7207ced0f25b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.388015 10746 ts_tablet_manager.cc:1939] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.388226 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4745699fa46c485ae7207ced0f25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.388790 10743 tablet_bootstrap.cc:492] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.388947 10743 ts_tablet_manager.cc:1397] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20260925 04:54:34.389498 10803 raft_consensus.cc:482] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.387164 10728 consensus_queue.cc:237] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.389878 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4745699fa46c485ae7207ced0f25b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.390700 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4745699fa46c485ae7207ced0f25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.391364 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.392771 10743 raft_consensus.cc:348] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.393024 10743 raft_consensus.cc:374] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.393115 10743 raft_consensus.cc:729] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.393329 10743 consensus_queue.cc:260] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.393878 10743 ts_tablet_manager.cc:1428] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260925 04:54:34.395699 10743 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.397905 10743 tablet_bootstrap.cc:654] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.398077 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet c123a26dd438443093ea8b3e63120ebb with delete_type TABLET_DATA_DELETED (replaced by tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.398334 10741 tablet_replica.cc:330] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.398520 10741 raft_consensus.cc:2229] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.398674 10741 raft_consensus.cc:2258] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.399945 10741 ts_tablet_manager.cc:1905] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.404239 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:34.404692 10585 catalog_manager.cc:6565] ReplaceTablet: tablet e356de6dc72f44c7b96b059ea792bdd0 deleted and replaced by tablet eb1e1f2f38a14a8cbdc7592c5b32ee76
I20260925 04:54:34.405112 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1e1f2f38a14a8cbdc7592c5b32ee76) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.405728 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1e1f2f38a14a8cbdc7592c5b32ee76) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.405975 10746 tablet_replica.cc:330] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.406155 10746 raft_consensus.cc:2229] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.406332 10746 raft_consensus.cc:2258] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.406455 10741 ts_tablet_manager.cc:1918] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.406582 10741 log.cc:1196] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/c123a26dd438443093ea8b3e63120ebb
I20260925 04:54:34.406842 10746 ts_tablet_manager.cc:1905] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.406913 10741 ts_tablet_manager.cc:1939] T c123a26dd438443093ea8b3e63120ebb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.409508 10741 tablet_replica.cc:330] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.409678 10741 raft_consensus.cc:2229] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.411164 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet c123a26dd438443093ea8b3e63120ebb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.415066 10741 raft_consensus.cc:2258] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.415126 10746 ts_tablet_manager.cc:1918] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.415293 10746 log.cc:1196] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:34.415673 10746 ts_tablet_manager.cc:1939] T e356de6dc72f44c7b96b059ea792bdd0 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.415858 10741 ts_tablet_manager.cc:1905] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.416638 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e356de6dc72f44c7b96b059ea792bdd0 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:34.419806 10747 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.421509 10747 tablet_bootstrap.cc:654] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.422645 10119 tablet_service.cc:1467] Processing CreateTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.423005 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.426175 10262 tablet_service.cc:1467] Processing CreateTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.426587 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.427294 10747 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.427448 10747 ts_tablet_manager.cc:1397] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20260925 04:54:34.428377 10747 raft_consensus.cc:348] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.428594 10747 raft_consensus.cc:374] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.428659 10747 raft_consensus.cc:729] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.428912 10747 consensus_queue.cc:260] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.429466 10747 ts_tablet_manager.cc:1428] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:34.429788 10747 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.431444 10747 tablet_bootstrap.cc:654] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.433919 10743 tablet_bootstrap.cc:492] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.434139 10743 ts_tablet_manager.cc:1397] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.003s
I20260925 04:54:34.435052 10743 raft_consensus.cc:348] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.435379 10743 raft_consensus.cc:374] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.435513 10743 raft_consensus.cc:729] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.435794 10743 consensus_queue.cc:260] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.437680 10743 ts_tablet_manager.cc:1428] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:34.438062 10743 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.439647 10743 tablet_bootstrap.cc:654] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.441912 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 9575bb4bffdc4ff6ad5cd40526739516 with delete_type TABLET_DATA_DELETED (replaced by tablet 1de6336c7812448a90d751a46809b643) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.440938 10741 ts_tablet_manager.cc:1918] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.445667 10741 log.cc:1196] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:34.389878 10803 raft_consensus.cc:504] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.446393 10741 ts_tablet_manager.cc:1939] T e356de6dc72f44c7b96b059ea792bdd0 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.447512 10803 leader_election.cc:288] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.447712 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e356de6dc72f44c7b96b059ea792bdd0 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:34.448050 10741 tablet_replica.cc:330] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.448264 10741 raft_consensus.cc:2229] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.448486 10741 raft_consensus.cc:2258] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.449690 10747 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.449709 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet e356de6dc72f44c7b96b059ea792bdd0 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1e1f2f38a14a8cbdc7592c5b32ee76) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.449847 10747 ts_tablet_manager.cc:1397] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.011s
W20260925 04:54:34.450398 10351 leader_election.cc:341] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e356de6dc72f44c7b96b059ea792bdd0
W20260925 04:54:34.450718 10353 leader_election.cc:341] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:34.450670 10747 raft_consensus.cc:348] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.450896 10747 raft_consensus.cc:374] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.450984 10747 raft_consensus.cc:729] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.451198 10353 leader_election.cc:302] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:34.451222 10747 consensus_queue.cc:260] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.451558 10803 raft_consensus.cc:2726] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:34.452181 10395 tablet_service.cc:1467] Processing CreateTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.452565 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.453595 10741 ts_tablet_manager.cc:1905] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.454730 10747 ts_tablet_manager.cc:1428] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 04:54:34.463197 10745 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.466982 10745 tablet_bootstrap.cc:654] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.467965 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 9575bb4bffdc4ff6ad5cd40526739516 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.468168 10744 ts_tablet_manager.cc:1918] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.468323 10744 log.cc:1196] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/2f90f2bc06f44e80b37e25f0ad0c6ab3
I20260925 04:54:34.468699 10744 ts_tablet_manager.cc:1939] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.469769 10744 tablet_replica.cc:330] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.469909 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.469973 10744 raft_consensus.cc:2229] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.470122 10744 raft_consensus.cc:2258] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.470765 10744 ts_tablet_manager.cc:1905] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.478268 10585 catalog_manager.cc:5495] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 604491977af14bc2b62f45a594c13bf9 (127.9.81.131). New cstate: current_term: 1 leader_uuid: "604491977af14bc2b62f45a594c13bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:34.480046 10744 ts_tablet_manager.cc:1918] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.480183 10744 log.cc:1196] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e356de6dc72f44c7b96b059ea792bdd0
I20260925 04:54:34.480546 10743 tablet_bootstrap.cc:492] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.480559 10744 ts_tablet_manager.cc:1939] T e356de6dc72f44c7b96b059ea792bdd0 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.480691 10743 ts_tablet_manager.cc:1397] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.043s user 0.009s sys 0.005s
I20260925 04:54:34.481604 10743 raft_consensus.cc:348] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.481843 10743 raft_consensus.cc:374] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.481937 10743 raft_consensus.cc:729] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.482182 10743 consensus_queue.cc:260] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.483093 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e356de6dc72f44c7b96b059ea792bdd0 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:34.483829 10745 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.483979 10745 ts_tablet_manager.cc:1397] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20260925 04:54:34.484709 10745 raft_consensus.cc:348] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.484921 10745 raft_consensus.cc:374] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.485024 10745 raft_consensus.cc:729] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.485119 10743 ts_tablet_manager.cc:1428] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:34.485253 10745 consensus_queue.cc:260] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.485387 10743 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.486582 10745 ts_tablet_manager.cc:1428] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:34.487483 10745 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.487963 10743 tablet_bootstrap.cc:654] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.488947 10745 tablet_bootstrap.cc:654] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.492271 10741 ts_tablet_manager.cc:1918] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.492420 10741 log.cc:1196] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/9575bb4bffdc4ff6ad5cd40526739516
I20260925 04:54:34.492831 10741 ts_tablet_manager.cc:1939] T 9575bb4bffdc4ff6ad5cd40526739516 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.493475 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 9575bb4bffdc4ff6ad5cd40526739516 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.503239 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 1de6336c7812448a90d751a46809b643 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.503839 10743 tablet_bootstrap.cc:492] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.504001 10743 ts_tablet_manager.cc:1397] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20260925 04:54:34.504786 10743 raft_consensus.cc:348] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.505043 10743 raft_consensus.cc:374] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.505119 10743 raft_consensus.cc:729] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.505378 10743 consensus_queue.cc:260] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.506022 10743 ts_tablet_manager.cc:1428] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:34.506317 10743 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.508440 10743 tablet_bootstrap.cc:654] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.515257 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 40d4745699fa46c485ae7207ced0f25b from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.518651 10745 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.518797 10745 ts_tablet_manager.cc:1397] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.024s
I20260925 04:54:34.519552 10745 raft_consensus.cc:348] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.519783 10745 raft_consensus.cc:374] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.519877 10745 raft_consensus.cc:729] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.520092 10745 consensus_queue.cc:260] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.520870 10745 ts_tablet_manager.cc:1428] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:34.520326 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 1de6336c7812448a90d751a46809b643
I20260925 04:54:34.522045 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de6336c7812448a90d751a46809b643 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f4f9f54ac44dc28629fabc0d2d4d95) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.522356 10746 tablet_replica.cc:330] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.522552 10746 raft_consensus.cc:2229] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.522746 10746 raft_consensus.cc:2258] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.523586 10746 ts_tablet_manager.cc:1905] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.523665 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de6336c7812448a90d751a46809b643 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f4f9f54ac44dc28629fabc0d2d4d95) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.523746 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 1de6336c7812448a90d751a46809b643 deleted and replaced by tablet a1f4f9f54ac44dc28629fabc0d2d4d95
I20260925 04:54:34.523864 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de6336c7812448a90d751a46809b643 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f4f9f54ac44dc28629fabc0d2d4d95) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.524116 10743 tablet_bootstrap.cc:492] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.524233 10743 ts_tablet_manager.cc:1397] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.001s
I20260925 04:54:34.525033 10743 raft_consensus.cc:348] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.525241 10743 raft_consensus.cc:374] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.525337 10743 raft_consensus.cc:729] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.526088 10743 consensus_queue.cc:260] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.526827 10743 ts_tablet_manager.cc:1428] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:34.527074 10743 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.528168 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 with delete_type TABLET_DATA_DELETED (replaced by tablet 40d4745699fa46c485ae7207ced0f25b) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.528802 10743 tablet_bootstrap.cc:654] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.529157 10741 tablet_replica.cc:330] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.529340 10741 raft_consensus.cc:2229] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.529517 10741 raft_consensus.cc:2258] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.526324 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de6336c7812448a90d751a46809b643 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f4f9f54ac44dc28629fabc0d2d4d95) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.531132 10741 ts_tablet_manager.cc:1905] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.531278 10744 tablet_replica.cc:330] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.531322 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 40d4745699fa46c485ae7207ced0f25b
I20260925 04:54:34.531456 10744 raft_consensus.cc:2229] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.531626 10744 raft_consensus.cc:2258] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.531705 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 40d4745699fa46c485ae7207ced0f25b deleted and replaced by tablet 9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.532358 10744 ts_tablet_manager.cc:1905] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.534247 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4745699fa46c485ae7207ced0f25b with delete_type TABLET_DATA_DELETED (replaced by tablet 9f843a64ce494cce934723ce339ff5a9) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.535427 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4745699fa46c485ae7207ced0f25b with delete_type TABLET_DATA_DELETED (replaced by tablet 9f843a64ce494cce934723ce339ff5a9) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.536412 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4745699fa46c485ae7207ced0f25b with delete_type TABLET_DATA_DELETED (replaced by tablet 9f843a64ce494cce934723ce339ff5a9) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.538173 10746 ts_tablet_manager.cc:1918] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.538352 10746 log.cc:1196] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/1de6336c7812448a90d751a46809b643
I20260925 04:54:34.538767 10746 ts_tablet_manager.cc:1939] T 1de6336c7812448a90d751a46809b643 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.539919 10746 tablet_replica.cc:330] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.539937 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 1de6336c7812448a90d751a46809b643 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.540112 10746 raft_consensus.cc:2229] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.540266 10746 raft_consensus.cc:2258] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.543607 10741 ts_tablet_manager.cc:1918] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.543725 10741 log.cc:1196] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/1de6336c7812448a90d751a46809b643
I20260925 04:54:34.544104 10741 ts_tablet_manager.cc:1939] T 1de6336c7812448a90d751a46809b643 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.545475 10260 tablet_service.cc:1467] Processing CreateTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.545871 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1f4f9f54ac44dc28629fabc0d2d4d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.546399 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 1de6336c7812448a90d751a46809b643 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.549314 10397 tablet_service.cc:1467] Processing CreateTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.549595 10119 tablet_service.cc:1467] Processing CreateTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.549696 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1f4f9f54ac44dc28629fabc0d2d4d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.549945 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1f4f9f54ac44dc28629fabc0d2d4d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.559199 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 9f843a64ce494cce934723ce339ff5a9 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.559603 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f843a64ce494cce934723ce339ff5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.559526 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 9f843a64ce494cce934723ce339ff5a9 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.559895 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f843a64ce494cce934723ce339ff5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.560010 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 40d4745699fa46c485ae7207ced0f25b from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.564610 10745 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.566059 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 9f843a64ce494cce934723ce339ff5a9 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.566205 10745 tablet_bootstrap.cc:654] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.566452 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f843a64ce494cce934723ce339ff5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.571626 10743 tablet_bootstrap.cc:492] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.571781 10743 ts_tablet_manager.cc:1397] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.012s
I20260925 04:54:34.572099 10746 ts_tablet_manager.cc:1905] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.572495 10743 raft_consensus.cc:348] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.572731 10743 raft_consensus.cc:374] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.572805 10743 raft_consensus.cc:729] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.573052 10743 consensus_queue.cc:260] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.573551 10743 ts_tablet_manager.cc:1428] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:34.573875 10743 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.578835 10744 ts_tablet_manager.cc:1918] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.579039 10744 log.cc:1196] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/1de6336c7812448a90d751a46809b643
I20260925 04:54:34.579550 10744 ts_tablet_manager.cc:1939] T 1de6336c7812448a90d751a46809b643 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.580572 10744 tablet_replica.cc:330] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.580816 10744 raft_consensus.cc:2229] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.581120 10746 ts_tablet_manager.cc:1918] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.581259 10746 log.cc:1196] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/40d4745699fa46c485ae7207ced0f25b
I20260925 04:54:34.581627 10746 ts_tablet_manager.cc:1939] T 40d4745699fa46c485ae7207ced0f25b P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.582589 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 40d4745699fa46c485ae7207ced0f25b (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.583487 10747 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.585146 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 1de6336c7812448a90d751a46809b643 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:34.585764 10747 tablet_bootstrap.cc:654] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.585948 10743 tablet_bootstrap.cc:654] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.595077 10744 raft_consensus.cc:2258] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.600046 10745 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.600217 10745 ts_tablet_manager.cc:1397] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.036s user 0.016s sys 0.008s
I20260925 04:54:34.601307 10745 raft_consensus.cc:348] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.601579 10745 raft_consensus.cc:374] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.601661 10745 raft_consensus.cc:729] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.601982 10745 consensus_queue.cc:260] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.604367 10745 ts_tablet_manager.cc:1428] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260925 04:54:34.604665 10745 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.605777 10744 ts_tablet_manager.cc:1905] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 04:54:34.608834 10578 catalog_manager.cc:4808] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 1de6336c7812448a90d751a46809b643 because the tablet was not found. No further retry: Not found: Tablet not found: 1de6336c7812448a90d751a46809b643
I20260925 04:54:34.609342 10741 tablet_replica.cc:330] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.612859 10745 tablet_bootstrap.cc:654] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.610184 10747 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.619415 10747 ts_tablet_manager.cc:1397] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.003s
I20260925 04:54:34.620975 10747 raft_consensus.cc:348] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.621304 10745 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.621510 10745 ts_tablet_manager.cc:1397] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.003s
I20260925 04:54:34.622437 10747 raft_consensus.cc:374] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.622721 10747 raft_consensus.cc:729] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.622891 10745 raft_consensus.cc:348] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.623121 10745 raft_consensus.cc:374] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.623224 10745 raft_consensus.cc:729] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.623474 10745 consensus_queue.cc:260] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.623464 10747 consensus_queue.cc:260] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.626806 10747 ts_tablet_manager.cc:1428] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260925 04:54:34.627758 10747 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.629667 10741 raft_consensus.cc:2229] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.631265 10741 raft_consensus.cc:2258] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.634599 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet fca5ab47510b47408fcad1b94eba0945 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.635877 10747 tablet_bootstrap.cc:654] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.632826 10743 tablet_bootstrap.cc:492] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.636473 10743 ts_tablet_manager.cc:1397] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.006s
I20260925 04:54:34.637861 10743 raft_consensus.cc:348] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.638804 10743 raft_consensus.cc:374] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.638994 10743 raft_consensus.cc:729] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.639348 10743 consensus_queue.cc:260] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.641227 10744 ts_tablet_manager.cc:1918] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.641434 10744 log.cc:1196] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/40d4745699fa46c485ae7207ced0f25b
I20260925 04:54:34.641649 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet fca5ab47510b47408fcad1b94eba0945
I20260925 04:54:34.641837 10744 ts_tablet_manager.cc:1939] T 40d4745699fa46c485ae7207ced0f25b P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.642557 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet fca5ab47510b47408fcad1b94eba0945 with delete_type TABLET_DATA_DELETED (replaced by tablet bd7ced0c92854b32a724d7320dafa306) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.643096 10585 catalog_manager.cc:6565] ReplaceTablet: tablet fca5ab47510b47408fcad1b94eba0945 deleted and replaced by tablet bd7ced0c92854b32a724d7320dafa306
I20260925 04:54:34.644054 10745 ts_tablet_manager.cc:1428] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260925 04:54:34.649228 10743 ts_tablet_manager.cc:1428] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 04:54:34.650946 10260 tablet_service.cc:1467] Processing CreateTablet for tablet bd7ced0c92854b32a724d7320dafa306 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.651355 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7ced0c92854b32a724d7320dafa306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.652267 10743 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.654016 10743 tablet_bootstrap.cc:654] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.632570 10741 ts_tablet_manager.cc:1905] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.648665 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet fca5ab47510b47408fcad1b94eba0945 with delete_type TABLET_DATA_DELETED (replaced by tablet bd7ced0c92854b32a724d7320dafa306) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.659745 10746 tablet_replica.cc:330] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.659937 10746 raft_consensus.cc:2229] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:34.660260 10746 pending_rounds.cc:62] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:34.660326 10746 pending_rounds.cc:68] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118255666839552 op_type: NO_OP noop_request { }
I20260925 04:54:34.660493 10746 raft_consensus.cc:2866] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:34.660600 10746 raft_consensus.cc:2258] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.661362 10746 ts_tablet_manager.cc:1905] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.651927 10119 tablet_service.cc:1467] Processing CreateTablet for tablet bd7ced0c92854b32a724d7320dafa306 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.665400 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7ced0c92854b32a724d7320dafa306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.665711 10746 ts_tablet_manager.cc:1918] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:34.665843 10746 log.cc:1196] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/fca5ab47510b47408fcad1b94eba0945
I20260925 04:54:34.666263 10746 ts_tablet_manager.cc:1939] T fca5ab47510b47408fcad1b94eba0945 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.667341 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet fca5ab47510b47408fcad1b94eba0945 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.672065 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.673949 10743 tablet_bootstrap.cc:492] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.674145 10743 ts_tablet_manager.cc:1397] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260925 04:54:34.675036 10743 raft_consensus.cc:348] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.675345 10743 raft_consensus.cc:374] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.675407 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet fca5ab47510b47408fcad1b94eba0945 with delete_type TABLET_DATA_DELETED (replaced by tablet bd7ced0c92854b32a724d7320dafa306) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.675450 10743 raft_consensus.cc:729] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.675791 10744 tablet_replica.cc:330] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.676002 10744 raft_consensus.cc:2229] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.676222 10744 raft_consensus.cc:2258] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.676440 10395 tablet_service.cc:1467] Processing CreateTablet for tablet bd7ced0c92854b32a724d7320dafa306 (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.676782 10741 ts_tablet_manager.cc:1918] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.676828 10744 ts_tablet_manager.cc:1905] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.676949 10741 log.cc:1196] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/2f90f2bc06f44e80b37e25f0ad0c6ab3
I20260925 04:54:34.677093 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7ced0c92854b32a724d7320dafa306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.677325 10741 ts_tablet_manager.cc:1939] T 2f90f2bc06f44e80b37e25f0ad0c6ab3 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.678347 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 2f90f2bc06f44e80b37e25f0ad0c6ab3 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.678674 10741 tablet_replica.cc:330] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.678859 10741 raft_consensus.cc:2229] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.679026 10741 raft_consensus.cc:2258] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.679725 10741 ts_tablet_manager.cc:1905] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.682716 10743 consensus_queue.cc:260] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.686972 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 40d4745699fa46c485ae7207ced0f25b (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.687505 10741 ts_tablet_manager.cc:1918] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.687618 10741 log.cc:1196] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/40d4745699fa46c485ae7207ced0f25b
I20260925 04:54:34.688052 10741 ts_tablet_manager.cc:1939] T 40d4745699fa46c485ae7207ced0f25b P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.691952 10747 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.692121 10747 ts_tablet_manager.cc:1397] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.001s
I20260925 04:54:34.692812 10747 raft_consensus.cc:348] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.694061 10743 ts_tablet_manager.cc:1428] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260925 04:54:34.694373 10743 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.693116 10747 raft_consensus.cc:374] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.696949 10747 raft_consensus.cc:729] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.697255 10747 consensus_queue.cc:260] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.699538 10744 ts_tablet_manager.cc:1918] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.699751 10744 log.cc:1196] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/fca5ab47510b47408fcad1b94eba0945
I20260925 04:54:34.700292 10744 ts_tablet_manager.cc:1939] T fca5ab47510b47408fcad1b94eba0945 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.700642 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 40d4745699fa46c485ae7207ced0f25b (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.701140 10741 tablet_replica.cc:330] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.701424 10741 raft_consensus.cc:2229] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.701644 10741 raft_consensus.cc:2258] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.702270 10741 ts_tablet_manager.cc:1905] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.702425 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet fca5ab47510b47408fcad1b94eba0945 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.702957 10747 ts_tablet_manager.cc:1428] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260925 04:54:34.703311 10745 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.705693 10745 tablet_bootstrap.cc:654] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.708684 10747 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.710434 10747 tablet_bootstrap.cc:654] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.713815 10743 tablet_bootstrap.cc:654] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.714444 10745 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.714627 10745 ts_tablet_manager.cc:1397] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260925 04:54:34.715457 10745 raft_consensus.cc:348] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.715741 10745 raft_consensus.cc:374] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.715829 10745 raft_consensus.cc:729] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.716130 10745 consensus_queue.cc:260] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.716861 10745 ts_tablet_manager.cc:1428] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:34.718240 10741 ts_tablet_manager.cc:1918] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.718438 10741 log.cc:1196] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/fca5ab47510b47408fcad1b94eba0945
I20260925 04:54:34.721814 10741 ts_tablet_manager.cc:1939] T fca5ab47510b47408fcad1b94eba0945 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.723634 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet fca5ab47510b47408fcad1b94eba0945 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.726194 10743 tablet_bootstrap.cc:492] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.726377 10743 ts_tablet_manager.cc:1397] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.001s
I20260925 04:54:34.727870 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f843a64ce494cce934723ce339ff5a9 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.729526 10743 raft_consensus.cc:348] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.729820 10743 raft_consensus.cc:374] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.730979 10747 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.731210 10747 ts_tablet_manager.cc:1397] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.004s
I20260925 04:54:34.731779 10743 raft_consensus.cc:729] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.732110 10743 consensus_queue.cc:260] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.733266 10747 raft_consensus.cc:348] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.733583 10747 raft_consensus.cc:374] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.733716 10747 raft_consensus.cc:729] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.734037 10747 consensus_queue.cc:260] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.735214 10743 ts_tablet_manager.cc:1428] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s
I20260925 04:54:34.738690 10743 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.740320 10747 ts_tablet_manager.cc:1428] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 04:54:34.745596 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet bd7ced0c92854b32a724d7320dafa306 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.748150 10743 tablet_bootstrap.cc:654] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.752208 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet bd7ced0c92854b32a724d7320dafa306
I20260925 04:54:34.753021 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet bd7ced0c92854b32a724d7320dafa306 with delete_type TABLET_DATA_DELETED (replaced by tablet 3328eecf0de44dd2ba5ab713d81739bb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.753325 10744 tablet_replica.cc:330] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.753557 10744 raft_consensus.cc:2229] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.753701 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet bd7ced0c92854b32a724d7320dafa306 with delete_type TABLET_DATA_DELETED (replaced by tablet 3328eecf0de44dd2ba5ab713d81739bb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.753757 10744 raft_consensus.cc:2258] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.753969 10746 tablet_replica.cc:330] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.754134 10746 raft_consensus.cc:2229] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.754302 10746 raft_consensus.cc:2258] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.754434 10744 ts_tablet_manager.cc:1905] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.755017 10746 ts_tablet_manager.cc:1905] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.755599 10591 catalog_manager.cc:3411] renamed table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166] in HMS: new name default.table_0b95ecb5a1304fb2a638058d060a2d1e
I20260925 04:54:34.755759 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.756445 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f843a64ce494cce934723ce339ff5a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4eefb778946d58a62ab2d5dde9f15) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.757088 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f843a64ce494cce934723ce339ff5a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4eefb778946d58a62ab2d5dde9f15) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.761085 10746 ts_tablet_manager.cc:1918] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.761199 10746 log.cc:1196] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/bd7ced0c92854b32a724d7320dafa306
I20260925 04:54:34.761569 10744 ts_tablet_manager.cc:1918] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.761629 10746 ts_tablet_manager.cc:1939] T bd7ced0c92854b32a724d7320dafa306 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.761740 10744 log.cc:1196] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/bd7ced0c92854b32a724d7320dafa306
I20260925 04:54:34.762179 10744 ts_tablet_manager.cc:1939] T bd7ced0c92854b32a724d7320dafa306 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.762566 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet bd7ced0c92854b32a724d7320dafa306 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.762830 10746 tablet_replica.cc:330] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.763209 10744 tablet_replica.cc:330] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.763330 10746 raft_consensus.cc:2229] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.763388 10744 raft_consensus.cc:2229] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.763479 10746 raft_consensus.cc:2258] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.763572 10744 raft_consensus.cc:2258] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.764060 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet bd7ced0c92854b32a724d7320dafa306 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.764948 10584 catalog_manager.cc:6565] ReplaceTablet: tablet bd7ced0c92854b32a724d7320dafa306 deleted and replaced by tablet 3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:34.765121 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 9f843a64ce494cce934723ce339ff5a9 deleted and replaced by tablet 64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:34.766593 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f843a64ce494cce934723ce339ff5a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4eefb778946d58a62ab2d5dde9f15) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.766894 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet bd7ced0c92854b32a724d7320dafa306 with delete_type TABLET_DATA_DELETED (replaced by tablet 3328eecf0de44dd2ba5ab713d81739bb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.767119 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f843a64ce494cce934723ce339ff5a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 64c4eefb778946d58a62ab2d5dde9f15) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.768498 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f843a64ce494cce934723ce339ff5a9 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.768532 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.768923 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3328eecf0de44dd2ba5ab713d81739bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.769618 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.769991 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4eefb778946d58a62ab2d5dde9f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.773677 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.774073 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3328eecf0de44dd2ba5ab713d81739bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.774453 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.774886 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4eefb778946d58a62ab2d5dde9f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.777954 10259 tablet_service.cc:1467] Processing CreateTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.778383 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c4eefb778946d58a62ab2d5dde9f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.779820 10743 tablet_bootstrap.cc:492] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.780026 10743 ts_tablet_manager.cc:1397] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.001s
I20260925 04:54:34.781061 10743 raft_consensus.cc:348] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.781363 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb (DEFAULT_TABLE table=default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.781472 10743 raft_consensus.cc:374] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.781571 10743 raft_consensus.cc:729] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.781793 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3328eecf0de44dd2ba5ab713d81739bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.781924 10743 consensus_queue.cc:260] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.785076 10745 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.785487 10747 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.786746 10745 tablet_bootstrap.cc:654] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.787182 10747 tablet_bootstrap.cc:654] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.791772 10746 ts_tablet_manager.cc:1905] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.798784 10744 ts_tablet_manager.cc:1905] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.798967 10741 tablet_replica.cc:330] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.799240 10741 raft_consensus.cc:2229] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.803606 10747 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.803862 10747 ts_tablet_manager.cc:1397] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.006s
I20260925 04:54:34.808816 10741 raft_consensus.cc:2258] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.808918 10747 raft_consensus.cc:348] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.809206 10747 raft_consensus.cc:374] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.809319 10747 raft_consensus.cc:729] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.809607 10747 consensus_queue.cc:260] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.811841 10741 ts_tablet_manager.cc:1905] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.813238 10747 ts_tablet_manager.cc:1428] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260925 04:54:34.816695 10747 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:34.824115 10761 raft_consensus.cc:482] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.824294 10761 raft_consensus.cc:504] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.827229 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1e1f2f38a14a8cbdc7592c5b32ee76" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:34.827502 10417 raft_consensus.cc:2454] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:34.827929 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1e1f2f38a14a8cbdc7592c5b32ee76" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:34.828169 10743 ts_tablet_manager.cc:1428] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260925 04:54:34.828594 10078 leader_election.cc:302] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.829070 10282 raft_consensus.cc:2454] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:34.824956 10761 leader_election.cc:288] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.830243 10761 raft_consensus.cc:2781] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:34.830369 10761 raft_consensus.cc:482] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:34.830495 10761 raft_consensus.cc:3037] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.834285 10743 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.834950 10761 raft_consensus.cc:504] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.835857 10744 ts_tablet_manager.cc:1918] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.836054 10744 log.cc:1196] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.837268 10761 leader_election.cc:288] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.839228 10744 ts_tablet_manager.cc:1939] T 9f843a64ce494cce934723ce339ff5a9 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:34.841173 10743 tablet_bootstrap.cc:654] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.842185 10745 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.842342 10745 ts_tablet_manager.cc:1397] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.057s user 0.019s sys 0.003s
I20260925 04:54:34.842422 10741 ts_tablet_manager.cc:1918] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.842552 10741 log.cc:1196] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.843273 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 9f843a64ce494cce934723ce339ff5a9 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.843048 10745 raft_consensus.cc:348] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.843608 10745 raft_consensus.cc:374] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.843700 10745 raft_consensus.cc:729] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.843910 10745 consensus_queue.cc:260] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.845108 10745 ts_tablet_manager.cc:1428] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:34.845438 10745 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.846968 10745 tablet_bootstrap.cc:654] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.849772 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1e1f2f38a14a8cbdc7592c5b32ee76" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:34.852639 10747 tablet_bootstrap.cc:654] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.855840 10728 raft_consensus.cc:482] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.855999 10728 raft_consensus.cc:504] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.856367 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1e1f2f38a14a8cbdc7592c5b32ee76" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:34.856560 10417 raft_consensus.cc:3037] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.856655 10728 leader_election.cc:288] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.859362 10417 raft_consensus.cc:2454] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:34.859795 10282 raft_consensus.cc:3037] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.860337 10078 leader_election.cc:302] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:34.860846 10849 raft_consensus.cc:2781] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:34.861166 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1f4f9f54ac44dc28629fabc0d2d4d95" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:34.861354 10281 raft_consensus.cc:2454] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:34.861842 10351 leader_election.cc:302] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:34.860910 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1f4f9f54ac44dc28629fabc0d2d4d95" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:34.862141 10144 raft_consensus.cc:2454] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:34.862334 10728 raft_consensus.cc:2781] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:34.862422 10728 raft_consensus.cc:482] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:34.862540 10728 raft_consensus.cc:3037] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.863848 10849 raft_consensus.cc:686] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:34.864269 10849 consensus_queue.cc:237] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.861967 10746 ts_tablet_manager.cc:1918] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.865010 10746 log.cc:1196] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.866010 10746 ts_tablet_manager.cc:1939] T 9f843a64ce494cce934723ce339ff5a9 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.867435 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 9f843a64ce494cce934723ce339ff5a9 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.867900 10282 raft_consensus.cc:2454] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:34.870038 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.864970 10728 raft_consensus.cc:504] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.872953 10728 leader_election.cc:288] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.875958 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 64c4eefb778946d58a62ab2d5dde9f15 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.878856 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet eb1e1f2f38a14a8cbdc7592c5b32ee76
I20260925 04:54:34.878850 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1f4f9f54ac44dc28629fabc0d2d4d95" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:34.879154 10282 raft_consensus.cc:3037] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.879299 10584 catalog_manager.cc:6565] ReplaceTablet: tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 deleted and replaced by tablet 310b2f74a992474aaa6dda8634eabf3e
I20260925 04:54:34.880110 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 with delete_type TABLET_DATA_DELETED (replaced by tablet 310b2f74a992474aaa6dda8634eabf3e) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.880373 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 with delete_type TABLET_DATA_DELETED (replaced by tablet 310b2f74a992474aaa6dda8634eabf3e) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.881496 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 with delete_type TABLET_DATA_DELETED (replaced by tablet 310b2f74a992474aaa6dda8634eabf3e) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.882072 10282 raft_consensus.cc:2454] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:34.882907 10351 leader_election.cc:302] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:34.883193 10728 raft_consensus.cc:2781] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:34.883862 10728 raft_consensus.cc:686] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:34.884114 10728 consensus_queue.cc:237] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.885341 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:34.885720 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 64c4eefb778946d58a62ab2d5dde9f15 deleted and replaced by tablet 34842bf4b6f44814a886cba18444cb6a
I20260925 04:54:34.886291 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 with delete_type TABLET_DATA_DELETED (replaced by tablet 34842bf4b6f44814a886cba18444cb6a) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.886301 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 with delete_type TABLET_DATA_DELETED (replaced by tablet 34842bf4b6f44814a886cba18444cb6a) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:34.888309 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 with delete_type TABLET_DATA_DELETED (replaced by tablet 34842bf4b6f44814a886cba18444cb6a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.889365 10741 ts_tablet_manager.cc:1939] T 9f843a64ce494cce934723ce339ff5a9 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.890429 10741 tablet_replica.cc:330] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.890640 10741 raft_consensus.cc:2229] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.890596 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 9f843a64ce494cce934723ce339ff5a9 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.890901 10741 raft_consensus.cc:2258] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.891727 10741 ts_tablet_manager.cc:1905] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.894870 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 310b2f74a992474aaa6dda8634eabf3e (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.895280 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310b2f74a992474aaa6dda8634eabf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.896178 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 310b2f74a992474aaa6dda8634eabf3e (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.896554 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310b2f74a992474aaa6dda8634eabf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.898692 10743 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:34.899768 10741 ts_tablet_manager.cc:1918] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.899909 10741 log.cc:1196] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/bd7ced0c92854b32a724d7320dafa306
I20260925 04:54:34.900272 10741 ts_tablet_manager.cc:1939] T bd7ced0c92854b32a724d7320dafa306 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.901975 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 310b2f74a992474aaa6dda8634eabf3e (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.902400 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310b2f74a992474aaa6dda8634eabf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.902834 10743 ts_tablet_manager.cc:1397] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.004s
I20260925 04:54:34.904064 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet bd7ced0c92854b32a724d7320dafa306 (table default.table_946f8d86c819438fbca12b46346be9a7 [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:34.903622 10743 raft_consensus.cc:348] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.904783 10743 raft_consensus.cc:374] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 04:54:34.904830 10578 catalog_manager.cc:4808] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 9f843a64ce494cce934723ce339ff5a9 because the tablet was not found. No further retry: Not found: Tablet not found: 9f843a64ce494cce934723ce339ff5a9
I20260925 04:54:34.904892 10743 raft_consensus.cc:729] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.906507 10744 tablet_replica.cc:330] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:34.906603 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1f4f9f54ac44dc28629fabc0d2d4d95" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:34.906731 10744 raft_consensus.cc:2229] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.906665 10743 consensus_queue.cc:260] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.906827 10144 raft_consensus.cc:3037] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.907222 10743 ts_tablet_manager.cc:1428] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 04:54:34.907593 10744 raft_consensus.cc:2258] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.911800 10144 raft_consensus.cc:2454] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:34.912396 10745 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:34.912552 10745 ts_tablet_manager.cc:1397] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.016s
I20260925 04:54:34.913420 10745 raft_consensus.cc:348] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.913762 10745 raft_consensus.cc:374] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.913889 10745 raft_consensus.cc:729] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.914120 10745 consensus_queue.cc:260] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.914741 10745 ts_tablet_manager.cc:1428] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:34.915439 10803 raft_consensus.cc:482] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.915577 10803 raft_consensus.cc:504] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.916013 10746 tablet_replica.cc:330] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.916188 10746 raft_consensus.cc:2229] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:34.916188 10803 leader_election.cc:288] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.916427 10746 pending_rounds.cc:62] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:34.916491 10746 pending_rounds.cc:68] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118258651942912 op_type: NO_OP noop_request { }
I20260925 04:54:34.916644 10746 raft_consensus.cc:2866] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:34.916747 10746 raft_consensus.cc:2258] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.911056 10743 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:34.916945 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
W20260925 04:54:34.917449 10351 leader_election.cc:341] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:34.918557 10743 tablet_bootstrap.cc:654] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:34.918447 10853 consensus_queue.cc:1159] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "270ea27d66a1425eae85f73563e04c00" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260925 04:54:34.924109 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 34842bf4b6f44814a886cba18444cb6a (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.924566 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34842bf4b6f44814a886cba18444cb6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.927762 10746 ts_tablet_manager.cc:1905] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.929561 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 34842bf4b6f44814a886cba18444cb6a (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.930172 10741 tablet_replica.cc:330] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.930367 10741 raft_consensus.cc:2229] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.930555 10741 raft_consensus.cc:2258] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.930812 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 34842bf4b6f44814a886cba18444cb6a (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:34.931344 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34842bf4b6f44814a886cba18444cb6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.931991 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:34.932189 10741 ts_tablet_manager.cc:1905] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.932250 10144 raft_consensus.cc:2454] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:34.932628 10353 leader_election.cc:302] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:34.933012 10803 raft_consensus.cc:2781] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:34.933118 10803 raft_consensus.cc:482] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:34.933200 10803 raft_consensus.cc:3037] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.937424 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34842bf4b6f44814a886cba18444cb6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:34.940900 10741 ts_tablet_manager.cc:1918] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.941042 10741 log.cc:1196] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/eb1e1f2f38a14a8cbdc7592c5b32ee76
I20260925 04:54:34.941423 10741 ts_tablet_manager.cc:1939] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.942406 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:34.942323 10803 raft_consensus.cc:504] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.942723 10741 tablet_replica.cc:330] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:34.942930 10741 raft_consensus.cc:2229] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.943092 10741 raft_consensus.cc:2258] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.943744 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:34.943856 10741 ts_tablet_manager.cc:1905] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 04:54:34.944334 10351 leader_election.cc:341] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:34.944476 10803 leader_election.cc:288] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.944980 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:34.945266 10144 raft_consensus.cc:3037] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.947974 10144 raft_consensus.cc:2454] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:34.948661 10746 ts_tablet_manager.cc:1918] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:34.948805 10746 log.cc:1196] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/eb1e1f2f38a14a8cbdc7592c5b32ee76
I20260925 04:54:34.948833 10353 leader_election.cc:302] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters: d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:34.949435 10803 raft_consensus.cc:2781] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:34.950242 10741 ts_tablet_manager.cc:1918] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:34.950395 10741 log.cc:1196] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:34.950798 10741 ts_tablet_manager.cc:1939] T 64c4eefb778946d58a62ab2d5dde9f15 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:34.951679 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 64c4eefb778946d58a62ab2d5dde9f15 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:34.952672 10744 ts_tablet_manager.cc:1905] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.957664 10747 tablet_bootstrap.cc:492] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:34.957844 10747 ts_tablet_manager.cc:1397] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.141s user 0.003s sys 0.000s
I20260925 04:54:34.958770 10747 raft_consensus.cc:348] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.959038 10747 raft_consensus.cc:374] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:34.959115 10747 raft_consensus.cc:729] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:34.961676 10745 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:34.964196 10745 tablet_bootstrap.cc:654] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:34.968361 10589 catalog_manager.cc:2148] created HMS catalog entry for table [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:34.969226 10585 master_service.cc:946] ReplaceTablet: received request to replace tablet 34842bf4b6f44814a886cba18444cb6a from {username='slave'} at 127.0.0.1:52548
W20260925 04:54:34.972548 10588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_97aab5f07e904b7580396563fdcec71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:34.973196 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 310b2f74a992474aaa6dda8634eabf3e from {username='slave'} at 127.0.0.1:52548
W20260925 04:54:34.973567 10593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_dae5fadcd7b441f2b0e36e307fe02b6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 04:54:34.974526 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 310b2f74a992474aaa6dda8634eabf3e from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:34.978380 10589 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52548 (request call id 5) took 2010 ms. Trace:
I20260925 04:54:34.978248 10747 consensus_queue.cc:260] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.978524 10589 rpcz_store.cc:276] 0925 04:54:32.967627 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.970415 (+ 2788us) service_pool.cc:227] Handling call
0925 04:54:32.989491 (+ 19076us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:32.990968 (+ 1477us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:34.968302 (+1977334us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:34.978010 (+ 9708us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:34.978106 (+ 96us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:34.978346 (+ 240us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:34.969161 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:34.969294 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:34.969302 (+ 8us) write_op.cc:435] Acquired schema lock
0925 04:54:34.969304 (+ 2us) tablet.cc:660] Decoding operations
0925 04:54:34.969400 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:34.969414 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:34.969419 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:34.969510 (+ 91us) tablet.cc:699] Row locks acquired
0925 04:54:34.969512 (+ 2us) write_op.cc:260] PREPARE: finished
0925 04:54:34.969550 (+ 38us) write_op.cc:270] Start()
0925 04:54:34.969587 (+ 37us) write_op.cc:276] Timestamp: P: 1790312074969516 usec, L: 0
0925 04:54:34.969591 (+ 4us) op_driver.cc:331] REPLICATION: starting
0925 04:54:34.969804 (+ 213us) log.cc:842] Serialized 432 byte log entry
0925 04:54:34.975708 (+ 5904us) op_driver.cc:444] REPLICATION: finished
0925 04:54:34.977444 (+ 1736us) write_op.cc:301] APPLY: starting
0925 04:54:34.977461 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:34.977504 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:34.977551 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:34.977662 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:34.977696 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:34.977704 (+ 8us) write_op.cc:312] APPLY: finished
0925 04:54:34.977770 (+ 66us) log.cc:842] Serialized 28 byte log entry
0925 04:54:34.977831 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:34.977848 (+ 17us) write_op.cc:454] Released schema lock
0925 04:54:34.977853 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:34.977901 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:34.977904 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1757942,"Hive Metastore.run_cpu_time_us":389,"Hive Metastore.run_wall_time_us":212802,"child_traces":[["op",{"apply.queue_time_us":1679,"apply.run_cpu_time_us":509,"apply.run_wall_time_us":509,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":778,"raft.queue_time_us":394,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"replication_time_us":6095}]]}
I20260925 04:54:34.984576 10747 ts_tablet_manager.cc:1428] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20260925 04:54:34.985234 10803 raft_consensus.cc:686] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:34.985625 10856 raft_consensus.cc:482] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.985859 10856 raft_consensus.cc:504] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.986893 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 310b2f74a992474aaa6dda8634eabf3e
I20260925 04:54:34.986907 10856 leader_election.cc:288] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:34.987308 10746 ts_tablet_manager.cc:1939] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:34.987383 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 310b2f74a992474aaa6dda8634eabf3e deleted and replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756
W20260925 04:54:34.987934 10351 leader_election.cc:341] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: 64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:34.988183 10552 raft_consensus.cc:482] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:34.988279 10746 tablet_replica.cc:330] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:34.988385 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 34842bf4b6f44814a886cba18444cb6a
I20260925 04:54:34.988456 10746 raft_consensus.cc:2229] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:34.988354 10552 raft_consensus.cc:504] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:34.988616 10746 raft_consensus.cc:2258] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:34.988760 10585 catalog_manager.cc:6565] ReplaceTablet: tablet 34842bf4b6f44814a886cba18444cb6a deleted and replaced by tablet 24c83b2ba7cd4a8eb90d338252051389
I20260925 04:54:34.988890 10552 leader_election.cc:288] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:34.990052 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet 34842bf4b6f44814a886cba18444cb6a with delete_type TABLET_DATA_DELETED (replaced by tablet 24c83b2ba7cd4a8eb90d338252051389) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:34.990058 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
W20260925 04:54:34.990957 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 34842bf4b6f44814a886cba18444cb6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34842bf4b6f44814a886cba18444cb6a already in progress: creating tablet
I20260925 04:54:34.991278 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:34.991750 10746 ts_tablet_manager.cc:1905] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:34.992359 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c4eefb778946d58a62ab2d5dde9f15" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
W20260925 04:54:34.993074 10353 leader_election.cc:341] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Illegal state: Tablet not RUNNING: STOPPED
I20260925 04:54:34.993209 10353 leader_election.cc:302] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:34.993803 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 34842bf4b6f44814a886cba18444cb6a with delete_type TABLET_DATA_DELETED (replaced by tablet 24c83b2ba7cd4a8eb90d338252051389) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:34.994077 10856 raft_consensus.cc:2726] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:34.994421 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76b0952a818425985a65da4b529b249" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:34.994802 10144 raft_consensus.cc:2379] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3c81f5b22cd4de9b25c02fd05b536b4 in current term 1: Already voted for candidate 604491977af14bc2b62f45a594c13bf9 in this term.
I20260925 04:54:34.995322 10218 leader_election.cc:302] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9
I20260925 04:54:34.995760 10552 raft_consensus.cc:3037] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:34.999086 10552 raft_consensus.cc:2726] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:34.999423 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.001283 10803 consensus_queue.cc:237] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.005062 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.005278 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 34842bf4b6f44814a886cba18444cb6a with delete_type TABLET_DATA_DELETED (replaced by tablet 24c83b2ba7cd4a8eb90d338252051389) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.006608 10746 ts_tablet_manager.cc:1918] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.006735 10746 log.cc:1196] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:35.007115 10746 ts_tablet_manager.cc:1939] T 64c4eefb778946d58a62ab2d5dde9f15 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.007656 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 64c4eefb778946d58a62ab2d5dde9f15 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.008628 10747 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.010263 10747 tablet_bootstrap.cc:654] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:35.011713 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 34842bf4b6f44814a886cba18444cb6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34842bf4b6f44814a886cba18444cb6a already in progress: creating tablet
I20260925 04:54:35.011818 10744 ts_tablet_manager.cc:1918] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.012178 10744 log.cc:1196] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/eb1e1f2f38a14a8cbdc7592c5b32ee76
I20260925 04:54:35.012684 10744 ts_tablet_manager.cc:1939] T eb1e1f2f38a14a8cbdc7592c5b32ee76 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.012732 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.013147 10743 tablet_bootstrap.cc:492] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.013324 10743 ts_tablet_manager.cc:1397] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.102s user 0.001s sys 0.015s
W20260925 04:54:35.013466 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 310b2f74a992474aaa6dda8634eabf3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 310b2f74a992474aaa6dda8634eabf3e already in progress: creating tablet
W20260925 04:54:35.013839 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 310b2f74a992474aaa6dda8634eabf3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 310b2f74a992474aaa6dda8634eabf3e already in progress: creating tablet
I20260925 04:54:35.014117 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet eb1e1f2f38a14a8cbdc7592c5b32ee76 (table default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.014114 10743 raft_consensus.cc:348] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.014370 10743 raft_consensus.cc:374] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.014441 10744 tablet_replica.cc:330] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.014463 10743 raft_consensus.cc:729] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.014658 10744 raft_consensus.cc:2229] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.014842 10744 raft_consensus.cc:2258] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.014719 10743 consensus_queue.cc:260] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.016100 10743 ts_tablet_manager.cc:1428] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.016394 10743 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.015702 10745 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.016772 10745 ts_tablet_manager.cc:1397] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.009s
I20260925 04:54:35.018370 10743 tablet_bootstrap.cc:654] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.015699 10744 ts_tablet_manager.cc:1905] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.019527 10747 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.020262 10745 raft_consensus.cc:348] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.020538 10745 raft_consensus.cc:374] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.020644 10745 raft_consensus.cc:729] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.020759 10747 ts_tablet_manager.cc:1397] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260925 04:54:35.020860 10745 consensus_queue.cc:260] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.024539 10745 ts_tablet_manager.cc:1428] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 04:54:35.021869 10747 raft_consensus.cc:348] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.024977 10747 raft_consensus.cc:374] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.025159 10747 raft_consensus.cc:729] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.025527 10745 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.025497 10747 consensus_queue.cc:260] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.025887 10744 ts_tablet_manager.cc:1918] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.026003 10744 log.cc:1196] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:35.026383 10747 ts_tablet_manager.cc:1428] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 04:54:35.026351 10744 ts_tablet_manager.cc:1939] T 64c4eefb778946d58a62ab2d5dde9f15 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.028424 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 64c4eefb778946d58a62ab2d5dde9f15 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.028589 10747 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
W20260925 04:54:35.029011 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 310b2f74a992474aaa6dda8634eabf3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 310b2f74a992474aaa6dda8634eabf3e already in progress: creating tablet
I20260925 04:54:35.029294 10744 tablet_replica.cc:330] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.029465 10744 raft_consensus.cc:2229] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.029610 10744 raft_consensus.cc:2258] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.030263 10745 tablet_bootstrap.cc:654] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.030845 10744 ts_tablet_manager.cc:1905] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.031744 10747 tablet_bootstrap.cc:654] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.032303 10743 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.032531 10743 ts_tablet_manager.cc:1397] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
I20260925 04:54:35.033300 10743 raft_consensus.cc:348] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.033613 10743 raft_consensus.cc:374] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.033708 10743 raft_consensus.cc:729] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.033947 10743 consensus_queue.cc:260] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.034485 10743 ts_tablet_manager.cc:1428] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:35.034749 10743 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.040256 10743 tablet_bootstrap.cc:654] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.045050 10744 ts_tablet_manager.cc:1918] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.045197 10744 log.cc:1196] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/34842bf4b6f44814a886cba18444cb6a
I20260925 04:54:35.045028 10589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:35.045403 10589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:35.045524 10744 ts_tablet_manager.cc:1939] T 34842bf4b6f44814a886cba18444cb6a P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.046456 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 34842bf4b6f44814a886cba18444cb6a (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.050276 10585 catalog_manager.cc:5495] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 604491977af14bc2b62f45a594c13bf9 (127.9.81.131). New cstate: current_term: 1 leader_uuid: "604491977af14bc2b62f45a594c13bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:35.051843 10743 tablet_bootstrap.cc:492] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.052042 10743 ts_tablet_manager.cc:1397] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20260925 04:54:35.052369 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 64c4eefb778946d58a62ab2d5dde9f15 with delete_type TABLET_DATA_DELETED (replaced by tablet 34842bf4b6f44814a886cba18444cb6a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.052711 10743 raft_consensus.cc:348] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.053017 10743 raft_consensus.cc:374] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.053115 10743 raft_consensus.cc:729] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.053427 10743 consensus_queue.cc:260] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.054003 10743 ts_tablet_manager.cc:1428] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260925 04:54:35.054065 10580 catalog_manager.cc:4808] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 64c4eefb778946d58a62ab2d5dde9f15 because the tablet was not found. No further retry: Not found: Tablet not found: 64c4eefb778946d58a62ab2d5dde9f15
I20260925 04:54:35.055787 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 34842bf4b6f44814a886cba18444cb6a with delete_type TABLET_DATA_DELETED (replaced by tablet 24c83b2ba7cd4a8eb90d338252051389) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.056020 10746 tablet_replica.cc:330] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.056224 10746 raft_consensus.cc:2229] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.056408 10746 raft_consensus.cc:2258] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.057049 10746 ts_tablet_manager.cc:1905] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.063279 10746 ts_tablet_manager.cc:1918] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 04:54:35.063519 10645 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3328eecf0de44dd2ba5ab713d81739bb consensus state has no leader
I20260925 04:54:35.063428 10746 log.cc:1196] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/34842bf4b6f44814a886cba18444cb6a
I20260925 04:54:35.064054 10746 ts_tablet_manager.cc:1939] T 34842bf4b6f44814a886cba18444cb6a P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.064947 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 34842bf4b6f44814a886cba18444cb6a (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.076092 10585 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]). Expected version 1 got 0
I20260925 04:54:35.078064 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.078588 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b6d49115f2f4a7985ec552e8f01f385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.081825 10584 catalog_manager.cc:5495] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 604491977af14bc2b62f45a594c13bf9 (127.9.81.131). New cstate: current_term: 1 leader_uuid: "604491977af14bc2b62f45a594c13bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260925 04:54:35.082125 10259 tablet_service.cc:1467] Processing CreateTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.082299 10584 catalog_manager.cc:5587] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105) does not have the latest schema for tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]). Expected version 1 got 0
I20260925 04:54:35.082511 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c83b2ba7cd4a8eb90d338252051389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.083771 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.083679 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.084160 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c83b2ba7cd4a8eb90d338252051389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.084187 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c83b2ba7cd4a8eb90d338252051389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.084192 10121 tablet_service.cc:1467] Processing CreateTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.084530 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d0df7a42694f6ba7bf4a2f2cea8756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.085251 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.085582 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d0df7a42694f6ba7bf4a2f2cea8756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.089064 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet e76b0952a818425985a65da4b529b249 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.089047 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (DEFAULT_TABLE table=default.table_e28617bb40fa4c7fac94b5a3467e7570 [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.089402 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d0df7a42694f6ba7bf4a2f2cea8756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.089293 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.090129 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b6d49115f2f4a7985ec552e8f01f385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.093778 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 3328eecf0de44dd2ba5ab713d81739bb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.094234 10552 raft_consensus.cc:482] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:35.094378 10552 raft_consensus.cc:504] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.094995 10552 leader_election.cc:288] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:35.095654 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:35.097069 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
W20260925 04:54:35.097673 10578 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3328eecf0de44dd2ba5ab713d81739bb consensus state has no leader
I20260925 04:54:35.097681 10743 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.098066 10144 raft_consensus.cc:2379] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3c81f5b22cd4de9b25c02fd05b536b4 in current term 1: Already voted for candidate 604491977af14bc2b62f45a594c13bf9 in this term.
I20260925 04:54:35.098552 10218 leader_election.cc:302] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9
I20260925 04:54:35.099093 10552 raft_consensus.cc:3037] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:35.099164 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.099429 10743 tablet_bootstrap.cc:654] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.099550 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b6d49115f2f4a7985ec552e8f01f385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.102562 10552 raft_consensus.cc:2726] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:35.108014 10743 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.108156 10743 ts_tablet_manager.cc:1397] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260925 04:54:35.108914 10743 raft_consensus.cc:348] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.109157 10743 raft_consensus.cc:374] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.109256 10743 raft_consensus.cc:729] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.109478 10743 consensus_queue.cc:260] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.110044 10743 ts_tablet_manager.cc:1428] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:35.110309 10743 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.112690 10743 tablet_bootstrap.cc:654] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:35.113844 10645 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21d0df7a42694f6ba7bf4a2f2cea8756 consensus state has no leader
I20260925 04:54:35.116392 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.116626 10741 tablet_replica.cc:330] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.116803 10741 raft_consensus.cc:2229] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.116967 10741 raft_consensus.cc:2258] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.117210 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e76b0952a818425985a65da4b529b249
I20260925 04:54:35.117664 10587 catalog_manager.cc:6565] ReplaceTablet: tablet e76b0952a818425985a65da4b529b249 deleted and replaced by tablet bd6a76ccc1034b538cb5354ac70e3d71
I20260925 04:54:35.117746 10741 ts_tablet_manager.cc:1905] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.120869 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet e76b0952a818425985a65da4b529b249 with delete_type TABLET_DATA_DELETED (replaced by tablet bd6a76ccc1034b538cb5354ac70e3d71) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.120540 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet e76b0952a818425985a65da4b529b249 with delete_type TABLET_DATA_DELETED (replaced by tablet bd6a76ccc1034b538cb5354ac70e3d71) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.122016 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 34842bf4b6f44814a886cba18444cb6a with delete_type TABLET_DATA_DELETED (replaced by tablet 24c83b2ba7cd4a8eb90d338252051389) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.122323 10746 tablet_replica.cc:330] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.122501 10746 raft_consensus.cc:2229] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.122666 10746 raft_consensus.cc:2258] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.123178 10746 ts_tablet_manager.cc:1905] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.126250 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet e76b0952a818425985a65da4b529b249 with delete_type TABLET_DATA_DELETED (replaced by tablet bd6a76ccc1034b538cb5354ac70e3d71) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.129182 10744 tablet_replica.cc:330] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.129371 10744 raft_consensus.cc:2229] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:35.129397 10746 ts_tablet_manager.cc:1918] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.129503 10746 log.cc:1196] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e76b0952a818425985a65da4b529b249
I20260925 04:54:35.130149 10744 pending_rounds.cc:62] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Trying to abort 1 pending ops.
I20260925 04:54:35.130229 10744 pending_rounds.cc:68] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118256703406080 op_type: NO_OP noop_request { }
I20260925 04:54:35.130403 10744 raft_consensus.cc:2866] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:35.130522 10744 raft_consensus.cc:2258] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.130748 10746 ts_tablet_manager.cc:1939] T e76b0952a818425985a65da4b529b249 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.131412 10744 ts_tablet_manager.cc:1905] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.132611 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e76b0952a818425985a65da4b529b249 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.137454 10744 ts_tablet_manager.cc:1918] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:35.137590 10744 log.cc:1196] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e76b0952a818425985a65da4b529b249
I20260925 04:54:35.138075 10744 ts_tablet_manager.cc:1939] T e76b0952a818425985a65da4b529b249 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.139118 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e76b0952a818425985a65da4b529b249 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.140225 10741 ts_tablet_manager.cc:1918] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.140378 10741 log.cc:1196] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/310b2f74a992474aaa6dda8634eabf3e
I20260925 04:54:35.140719 10741 ts_tablet_manager.cc:1939] T 310b2f74a992474aaa6dda8634eabf3e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.141767 10741 tablet_replica.cc:330] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.141919 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 310b2f74a992474aaa6dda8634eabf3e (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.141974 10741 raft_consensus.cc:2229] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.142118 10741 raft_consensus.cc:2258] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.142661 10741 ts_tablet_manager.cc:1905] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.143249 10745 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.143478 10745 ts_tablet_manager.cc:1397] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.119s user 0.012s sys 0.011s
I20260925 04:54:35.144466 10745 raft_consensus.cc:348] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.144814 10745 raft_consensus.cc:374] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.144953 10745 raft_consensus.cc:729] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.145361 10745 consensus_queue.cc:260] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.146759 10745 ts_tablet_manager.cc:1428] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.148586 10745 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.151117 10747 tablet_bootstrap.cc:492] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.151290 10741 ts_tablet_manager.cc:1918] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.151362 10747 ts_tablet_manager.cc:1397] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.125s user 0.012s sys 0.003s
I20260925 04:54:35.151465 10741 log.cc:1196] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e76b0952a818425985a65da4b529b249
I20260925 04:54:35.151846 10741 ts_tablet_manager.cc:1939] T e76b0952a818425985a65da4b529b249 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.152061 10747 raft_consensus.cc:348] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.152304 10747 raft_consensus.cc:374] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.152380 10747 raft_consensus.cc:729] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.152619 10747 consensus_queue.cc:260] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.152712 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e76b0952a818425985a65da4b529b249 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.153656 10741 tablet_replica.cc:330] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.153816 10741 raft_consensus.cc:2229] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.153838 10747 ts_tablet_manager.cc:1428] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:35.153973 10741 raft_consensus.cc:2258] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.154122 10747 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.154698 10741 ts_tablet_manager.cc:1905] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.155690 10747 tablet_bootstrap.cc:654] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.160643 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.160892 10746 tablet_replica.cc:330] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.161104 10746 raft_consensus.cc:2229] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.161253 10746 raft_consensus.cc:2258] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.161885 10746 ts_tablet_manager.cc:1905] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.162104 10741 ts_tablet_manager.cc:1918] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.162199 10741 log.cc:1196] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/34842bf4b6f44814a886cba18444cb6a
I20260925 04:54:35.162523 10741 ts_tablet_manager.cc:1939] T 34842bf4b6f44814a886cba18444cb6a P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.163368 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 34842bf4b6f44814a886cba18444cb6a (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.167945 10746 ts_tablet_manager.cc:1918] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.168087 10746 log.cc:1196] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/310b2f74a992474aaa6dda8634eabf3e
I20260925 04:54:35.168100 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:35.168449 10746 ts_tablet_manager.cc:1939] T 310b2f74a992474aaa6dda8634eabf3e P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.168567 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 3328eecf0de44dd2ba5ab713d81739bb deleted and replaced by tablet 3d12f6ea5d4c42569a19f6013b616439
I20260925 04:54:35.169873 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12f6ea5d4c42569a19f6013b616439) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.170128 10741 tablet_replica.cc:330] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.170370 10741 raft_consensus.cc:2229] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.170405 10585 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.170607 10741 raft_consensus.cc:2258] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.171612 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 310b2f74a992474aaa6dda8634eabf3e (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.171799 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12f6ea5d4c42569a19f6013b616439) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.172792 10741 ts_tablet_manager.cc:1905] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.173105 10590 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52548 (request call id 4) took 2205 ms. Trace:
I20260925 04:54:35.173226 10590 rpcz_store.cc:276] 0925 04:54:32.967547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.969910 (+ 2363us) service_pool.cc:227] Handling call
0925 04:54:32.986846 (+ 16936us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:35.172366 (+2185520us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:35.172721 (+ 355us) catalog_manager.cc:3616] Apply alter schema
0925 04:54:35.173045 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":12772,"Hive Metastore.run_cpu_time_us":1565,"Hive Metastore.run_wall_time_us":1208055}
I20260925 04:54:35.174044 10747 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.174187 10747 ts_tablet_manager.cc:1397] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260925 04:54:35.175029 10746 tablet_replica.cc:330] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.175002 10591 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52548 (request call id 3) took 2207 ms. Trace:
I20260925 04:54:35.175099 10591 rpcz_store.cc:276] 0925 04:54:32.967455 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.969069 (+ 1614us) service_pool.cc:227] Handling call
0925 04:54:32.990247 (+ 21178us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:35.174409 (+2184162us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:35.174714 (+ 305us) catalog_manager.cc:3616] Apply alter schema
0925 04:54:35.174942 (+ 228us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1217467,"Hive Metastore.run_cpu_time_us":928,"Hive Metastore.run_wall_time_us":547318}
I20260925 04:54:35.177071 10747 raft_consensus.cc:348] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.177373 10747 raft_consensus.cc:374] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.178390 10746 raft_consensus.cc:2229] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.178473 10590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:35.178655 10746 raft_consensus.cc:2258] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.178669 10590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:35.178870 10747 raft_consensus.cc:729] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.179543 10746 ts_tablet_manager.cc:1905] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.179418 10747 consensus_queue.cc:260] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.180888 10747 ts_tablet_manager.cc:1428] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260925 04:54:35.181993 10747 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.182214 10585 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_b32729c82a4b4c558c9a830e172a0c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:35.183658 10747 tablet_bootstrap.cc:654] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.186779 10591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:35.186980 10591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:35.195416 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet 24c83b2ba7cd4a8eb90d338252051389 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.195585 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 24c83b2ba7cd4a8eb90d338252051389 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.195624 10741 ts_tablet_manager.cc:1918] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.195747 10741 log.cc:1196] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:35.195915 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 21d0df7a42694f6ba7bf4a2f2cea8756 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.196085 10741 ts_tablet_manager.cc:1939] T 3328eecf0de44dd2ba5ab713d81739bb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.196866 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.197295 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d12f6ea5d4c42569a19f6013b616439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.197381 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.198450 10746 ts_tablet_manager.cc:1918] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.198606 10746 log.cc:1196] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:35.198962 10746 ts_tablet_manager.cc:1939] T 3328eecf0de44dd2ba5ab713d81739bb P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.200490 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.200832 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d12f6ea5d4c42569a19f6013b616439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.202217 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.153013 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 310b2f74a992474aaa6dda8634eabf3e with delete_type TABLET_DATA_DELETED (replaced by tablet 21d0df7a42694f6ba7bf4a2f2cea8756) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.205245 10744 tablet_replica.cc:330] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.205291 10121 tablet_service.cc:1467] Processing CreateTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.205425 10744 raft_consensus.cc:2229] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.205606 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6a76ccc1034b538cb5354ac70e3d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.205607 10744 raft_consensus.cc:2258] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.172045 10397 tablet_service.cc:1514] Processing DeleteTablet for tablet 3328eecf0de44dd2ba5ab713d81739bb with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12f6ea5d4c42569a19f6013b616439) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.195098 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.206426 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d12f6ea5d4c42569a19f6013b616439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.208931 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 24c83b2ba7cd4a8eb90d338252051389
I20260925 04:54:35.209215 10259 tablet_service.cc:1467] Processing CreateTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.209362 10587 catalog_manager.cc:6565] ReplaceTablet: tablet 24c83b2ba7cd4a8eb90d338252051389 deleted and replaced by tablet 64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.209578 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6a76ccc1034b538cb5354ac70e3d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.211304 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 with delete_type TABLET_DATA_DELETED (replaced by tablet 64f2472995cf460899483e7ee0abfd71) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.199662 10395 tablet_service.cc:1467] Processing CreateTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 04:54:35.203258 10351 consensus_peers.cc:487] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 -> Peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Couldn't send request to peer d3c81f5b22cd4de9b25c02fd05b536b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3328eecf0de44dd2ba5ab713d81739bb. This is attempt 1: this message will repeat every 5th retry.
W20260925 04:54:35.203673 10353 consensus_peers.cc:487] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 -> Peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Couldn't send request to peer 270ea27d66a1425eae85f73563e04c00. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3328eecf0de44dd2ba5ab713d81739bb. This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:35.212607 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 21d0df7a42694f6ba7bf4a2f2cea8756
I20260925 04:54:35.212932 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd6a76ccc1034b538cb5354ac70e3d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.213035 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 21d0df7a42694f6ba7bf4a2f2cea8756 deleted and replaced by tablet 689a7134c47543feaf5c453171ecb75a
I20260925 04:54:35.213109 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 with delete_type TABLET_DATA_DELETED (replaced by tablet 64f2472995cf460899483e7ee0abfd71) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.213685 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 with delete_type TABLET_DATA_DELETED (replaced by tablet 689a7134c47543feaf5c453171ecb75a) from {username='slave'} at 127.0.0.1:49620
W20260925 04:54:35.213802 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 24c83b2ba7cd4a8eb90d338252051389 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24c83b2ba7cd4a8eb90d338252051389 already in progress: creating tablet
I20260925 04:54:35.214210 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 with delete_type TABLET_DATA_DELETED (replaced by tablet 64f2472995cf460899483e7ee0abfd71) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.214527 10746 tablet_replica.cc:330] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.214771 10746 raft_consensus.cc:2229] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.214983 10746 raft_consensus.cc:2258] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.215785 10746 ts_tablet_manager.cc:1905] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.216180 10741 tablet_replica.cc:330] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.216241 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 with delete_type TABLET_DATA_DELETED (replaced by tablet 689a7134c47543feaf5c453171ecb75a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.216351 10741 raft_consensus.cc:2229] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.216552 10741 raft_consensus.cc:2258] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.217270 10741 ts_tablet_manager.cc:1905] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.217447 10744 ts_tablet_manager.cc:1905] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.218233 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 with delete_type TABLET_DATA_DELETED (replaced by tablet 689a7134c47543feaf5c453171ecb75a) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.220652 10745 tablet_bootstrap.cc:654] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.223737 10744 ts_tablet_manager.cc:1918] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.223873 10744 log.cc:1196] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/310b2f74a992474aaa6dda8634eabf3e
I20260925 04:54:35.224242 10744 ts_tablet_manager.cc:1939] T 310b2f74a992474aaa6dda8634eabf3e P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.225209 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 310b2f74a992474aaa6dda8634eabf3e (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.225502 10744 tablet_replica.cc:330] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.225441 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 64f2472995cf460899483e7ee0abfd71 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.225833 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f2472995cf460899483e7ee0abfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.226130 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 689a7134c47543feaf5c453171ecb75a (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.226454 10746 ts_tablet_manager.cc:1918] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.226531 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689a7134c47543feaf5c453171ecb75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.226667 10746 log.cc:1196] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/24c83b2ba7cd4a8eb90d338252051389
I20260925 04:54:35.226713 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 64f2472995cf460899483e7ee0abfd71 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.227093 10746 ts_tablet_manager.cc:1939] T 24c83b2ba7cd4a8eb90d338252051389 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.227531 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f2472995cf460899483e7ee0abfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.228724 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 689a7134c47543feaf5c453171ecb75a (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.229100 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689a7134c47543feaf5c453171ecb75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.229171 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 24c83b2ba7cd4a8eb90d338252051389 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
W20260925 04:54:35.229435 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d0df7a42694f6ba7bf4a2f2cea8756 already in progress: creating tablet
I20260925 04:54:35.229592 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 689a7134c47543feaf5c453171ecb75a (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.229964 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 689a7134c47543feaf5c453171ecb75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.234812 10744 raft_consensus.cc:2229] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:35.235296 10744 pending_rounds.cc:62] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Trying to abort 2 pending ops.
I20260925 04:54:35.235428 10744 pending_rounds.cc:68] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7333118259993956352 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "3328eecf0de44dd2ba5ab713d81739bb" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.table_6c52826d192a4ccda763b30ee29815ad" dest_uuid: "604491977af14bc2b62f45a594c13bf9" new_extra_config { } }
I20260925 04:54:35.235926 10745 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.236070 10745 ts_tablet_manager.cc:1397] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.003s
W20260925 04:54:35.235932 10744 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54288: Aborted: Op aborted
I20260925 04:54:35.236872 10745 raft_consensus.cc:348] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:35.237397 10745 raft_consensus.cc:374] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.237512 10745 raft_consensus.cc:729] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
W20260925 04:54:35.238543 10579 catalog_manager.cc:4920] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): alter failed for tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]): Aborted: Op aborted
I20260925 04:54:35.239238 10744 pending_rounds.cc:68] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118259224338432 op_type: NO_OP noop_request { }
I20260925 04:54:35.239971 10121 tablet_service.cc:1467] Processing CreateTablet for tablet 64f2472995cf460899483e7ee0abfd71 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.240176 10745 consensus_queue.cc:260] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:35.240398 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f2472995cf460899483e7ee0abfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.239411 10744 raft_consensus.cc:2866] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:35.240641 10744 raft_consensus.cc:2258] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.244537 10745 ts_tablet_manager.cc:1428] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 04:54:35.245576 10744 ts_tablet_manager.cc:1905] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.245965 10743 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.250329 10745 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.251780 10745 tablet_bootstrap.cc:654] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:35.252517 10796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:35.252910 10796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:35.253082 10796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260925 04:54:35.257721 10745 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.257890 10745 ts_tablet_manager.cc:1397] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260925 04:54:35.258617 10745 raft_consensus.cc:348] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.258932 10745 raft_consensus.cc:374] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.259011 10745 raft_consensus.cc:729] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.259261 10745 consensus_queue.cc:260] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.262967 10745 ts_tablet_manager.cc:1428] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 04:54:35.247149 10741 ts_tablet_manager.cc:1918] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.266240 10741 log.cc:1196] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/21d0df7a42694f6ba7bf4a2f2cea8756
I20260925 04:54:35.266705 10741 ts_tablet_manager.cc:1939] T 21d0df7a42694f6ba7bf4a2f2cea8756 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.266835 10743 ts_tablet_manager.cc:1397] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.156s user 0.010s sys 0.012s
I20260925 04:54:35.266945 10745 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.267216 10747 tablet_bootstrap.cc:492] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.267761 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.268514 10745 tablet_bootstrap.cc:654] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.268757 10747 ts_tablet_manager.cc:1397] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.000s
I20260925 04:54:35.269503 10747 raft_consensus.cc:348] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.269897 10743 raft_consensus.cc:348] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.270088 10744 ts_tablet_manager.cc:1918] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 04:54:35.270202 10744 log.cc:1196] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:35.270237 10743 raft_consensus.cc:374] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.270424 10743 raft_consensus.cc:729] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.270599 10744 ts_tablet_manager.cc:1939] T 3328eecf0de44dd2ba5ab713d81739bb P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.270817 10747 raft_consensus.cc:374] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.270952 10743 consensus_queue.cc:260] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.271224 10747 raft_consensus.cc:729] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.271522 10747 consensus_queue.cc:260] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.271718 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
W20260925 04:54:35.272300 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 24c83b2ba7cd4a8eb90d338252051389 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24c83b2ba7cd4a8eb90d338252051389 already in progress: creating tablet
I20260925 04:54:35.273293 10743 ts_tablet_manager.cc:1428] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 04:54:35.276875 10744 tablet_replica.cc:330] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.277279 10743 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.278033 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 with delete_type TABLET_DATA_DELETED (replaced by tablet 64f2472995cf460899483e7ee0abfd71) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.278571 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 with delete_type TABLET_DATA_DELETED (replaced by tablet 689a7134c47543feaf5c453171ecb75a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.278697 10744 raft_consensus.cc:2229] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.278880 10744 raft_consensus.cc:2258] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.279366 10741 tablet_replica.cc:330] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
W20260925 04:54:35.279435 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d0df7a42694f6ba7bf4a2f2cea8756 already in progress: creating tablet
I20260925 04:54:35.279577 10744 ts_tablet_manager.cc:1905] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.279706 10741 raft_consensus.cc:2229] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.280012 10741 raft_consensus.cc:2258] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.280058 10747 ts_tablet_manager.cc:1428] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
W20260925 04:54:35.280973 10796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:35.281118 10796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:35.281189 10796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:35.281270 10796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:35.282855 10741 ts_tablet_manager.cc:1905] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.289609 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d0df7a42694f6ba7bf4a2f2cea8756 with delete_type TABLET_DATA_DELETED (replaced by tablet 689a7134c47543feaf5c453171ecb75a) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.289757 10747 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.289989 10746 tablet_replica.cc:330] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.290151 10746 raft_consensus.cc:2229] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.290330 10746 raft_consensus.cc:2258] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.291174 10746 ts_tablet_manager.cc:1905] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.297389 10746 ts_tablet_manager.cc:1918] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.297519 10746 log.cc:1196] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/21d0df7a42694f6ba7bf4a2f2cea8756
I20260925 04:54:35.297904 10746 ts_tablet_manager.cc:1939] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.298830 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.301299 10743 tablet_bootstrap.cc:654] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.301709 10747 tablet_bootstrap.cc:654] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.301863 10745 tablet_bootstrap.cc:492] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.302012 10745 ts_tablet_manager.cc:1397] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.004s
I20260925 04:54:35.302860 10745 raft_consensus.cc:348] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.303123 10745 raft_consensus.cc:374] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.303213 10745 raft_consensus.cc:729] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.303524 10745 consensus_queue.cc:260] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.308867 10741 ts_tablet_manager.cc:1918] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.309077 10741 log.cc:1196] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/24c83b2ba7cd4a8eb90d338252051389
I20260925 04:54:35.309069 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 24c83b2ba7cd4a8eb90d338252051389 with delete_type TABLET_DATA_DELETED (replaced by tablet 64f2472995cf460899483e7ee0abfd71) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.309507 10741 ts_tablet_manager.cc:1939] T 24c83b2ba7cd4a8eb90d338252051389 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.309566 10745 ts_tablet_manager.cc:1428] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260925 04:54:35.310540 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 24c83b2ba7cd4a8eb90d338252051389 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.313942 10745 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.314500 10796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.81.190
--webserver_port=33381
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:35.316243 10796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:35.317730 10745 tablet_bootstrap.cc:654] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.318393 10796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260925 04:54:35.321134 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 3b6d49115f2f4a7985ec552e8f01f385 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.323060 10747 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.323307 10747 ts_tablet_manager.cc:1397] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.007s
I20260925 04:54:35.324297 10747 raft_consensus.cc:348] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:35.325486 10747 raft_consensus.cc:374] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.325819 10743 tablet_bootstrap.cc:492] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.325976 10743 ts_tablet_manager.cc:1397] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.001s
I20260925 04:54:35.326720 10743 raft_consensus.cc:348] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:35.326978 10743 raft_consensus.cc:374] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.327628 10743 raft_consensus.cc:729] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.327926 10743 consensus_queue.cc:260] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
W20260925 04:54:35.328092 10579 catalog_manager.cc:4914] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): alter failed for tablet 3328eecf0de44dd2ba5ab713d81739bb (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]),no further retry: Not found: Tablet not found: 3328eecf0de44dd2ba5ab713d81739bb
I20260925 04:54:35.328655 10743 ts_tablet_manager.cc:1428] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:35.328878 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 3b6d49115f2f4a7985ec552e8f01f385
I20260925 04:54:35.329303 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 3b6d49115f2f4a7985ec552e8f01f385 deleted and replaced by tablet b85a274b180645fc9ad9678b86bfb706
I20260925 04:54:35.330042 10743 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.332619 10743 tablet_bootstrap.cc:654] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.335345 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 with delete_type TABLET_DATA_DELETED (replaced by tablet b85a274b180645fc9ad9678b86bfb706) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.335628 10741 tablet_replica.cc:330] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.335783 10741 raft_consensus.cc:2229] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.335948 10741 raft_consensus.cc:2258] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.336156 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 with delete_type TABLET_DATA_DELETED (replaced by tablet b85a274b180645fc9ad9678b86bfb706) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.336545 10741 ts_tablet_manager.cc:1905] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.335680 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 with delete_type TABLET_DATA_DELETED (replaced by tablet b85a274b180645fc9ad9678b86bfb706) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.337212 10747 raft_consensus.cc:729] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.337469 10747 consensus_queue.cc:260] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
W20260925 04:54:35.337673 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 3b6d49115f2f4a7985ec552e8f01f385 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b6d49115f2f4a7985ec552e8f01f385 already in progress: creating tablet
I20260925 04:54:35.338050 10747 ts_tablet_manager.cc:1428] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260925 04:54:35.338315 10747 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.341557 10260 tablet_service.cc:1467] Processing CreateTablet for tablet b85a274b180645fc9ad9678b86bfb706 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.341958 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b85a274b180645fc9ad9678b86bfb706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.341977 10395 tablet_service.cc:1467] Processing CreateTablet for tablet b85a274b180645fc9ad9678b86bfb706 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.342376 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b85a274b180645fc9ad9678b86bfb706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.348488 10741 ts_tablet_manager.cc:1918] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.348649 10741 log.cc:1196] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/3b6d49115f2f4a7985ec552e8f01f385
I20260925 04:54:35.349094 10741 ts_tablet_manager.cc:1939] T 3b6d49115f2f4a7985ec552e8f01f385 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.350128 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 3b6d49115f2f4a7985ec552e8f01f385 (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]) successfully deleted
I20260925 04:54:35.351015 10121 tablet_service.cc:1467] Processing CreateTablet for tablet b85a274b180645fc9ad9678b86bfb706 (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.351428 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b85a274b180645fc9ad9678b86bfb706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.353410 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b6d49115f2f4a7985ec552e8f01f385 with delete_type TABLET_DATA_DELETED (replaced by tablet b85a274b180645fc9ad9678b86bfb706) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.353658 10746 tablet_replica.cc:330] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.353859 10746 raft_consensus.cc:2229] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.354036 10746 raft_consensus.cc:2258] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.355279 10743 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.355412 10743 ts_tablet_manager.cc:1397] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.001s
I20260925 04:54:35.355777 10744 ts_tablet_manager.cc:1918] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.355917 10744 log.cc:1196] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/21d0df7a42694f6ba7bf4a2f2cea8756
I20260925 04:54:35.356252 10744 ts_tablet_manager.cc:1939] T 21d0df7a42694f6ba7bf4a2f2cea8756 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.356118 10743 raft_consensus.cc:348] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.356393 10743 raft_consensus.cc:374] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.356458 10743 raft_consensus.cc:729] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.357129 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 21d0df7a42694f6ba7bf4a2f2cea8756 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
I20260925 04:54:35.358387 10743 consensus_queue.cc:260] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.361202 10746 ts_tablet_manager.cc:1905] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.361804 10743 ts_tablet_manager.cc:1428] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 04:54:35.362043 10744 tablet_replica.cc:330] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.362293 10744 raft_consensus.cc:2229] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.362448 10744 raft_consensus.cc:2258] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.363276 10743 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.364573 10744 ts_tablet_manager.cc:1905] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.367877 10743 tablet_bootstrap.cc:654] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.368567 10746 ts_tablet_manager.cc:1918] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.368799 10746 log.cc:1196] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/3b6d49115f2f4a7985ec552e8f01f385
I20260925 04:54:35.369307 10746 ts_tablet_manager.cc:1939] T 3b6d49115f2f4a7985ec552e8f01f385 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.370802 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 3b6d49115f2f4a7985ec552e8f01f385 (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]) successfully deleted
I20260925 04:54:35.372213 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 64f2472995cf460899483e7ee0abfd71 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.373776 10745 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.373934 10745 ts_tablet_manager.cc:1397] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.009s
I20260925 04:54:35.374634 10745 raft_consensus.cc:348] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.374866 10745 raft_consensus.cc:374] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.374950 10745 raft_consensus.cc:729] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.375218 10745 consensus_queue.cc:260] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.375605 10747 tablet_bootstrap.cc:654] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.377135 10745 ts_tablet_manager.cc:1428] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:35.377414 10745 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.378288 10587 catalog_manager.cc:5587] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105) does not have the latest schema for tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]). Expected version 1 got 0
W20260925 04:54:35.378711 10587 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3d12f6ea5d4c42569a19f6013b616439 consensus state has no leader
I20260925 04:54:35.378916 10745 tablet_bootstrap.cc:654] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.379845 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.380312 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 64f2472995cf460899483e7ee0abfd71 deleted and replaced by tablet d32df986f4bd4058ae07a90047188d0f
I20260925 04:54:35.380621 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:46148
W20260925 04:54:35.381331 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 64f2472995cf460899483e7ee0abfd71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64f2472995cf460899483e7ee0abfd71 already in progress: creating tablet
I20260925 04:54:35.382879 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:49620
W20260925 04:54:35.383745 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 64f2472995cf460899483e7ee0abfd71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64f2472995cf460899483e7ee0abfd71 already in progress: creating tablet
I20260925 04:54:35.391095 10260 tablet_service.cc:1467] Processing CreateTablet for tablet d32df986f4bd4058ae07a90047188d0f (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.391389 10121 tablet_service.cc:1467] Processing CreateTablet for tablet d32df986f4bd4058ae07a90047188d0f (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.391552 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32df986f4bd4058ae07a90047188d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.391773 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32df986f4bd4058ae07a90047188d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.392200 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.392022 10586 catalog_manager.cc:5587] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105) does not have the latest schema for tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]). Expected version 1 got 0
I20260925 04:54:35.393952 10394 tablet_service.cc:1467] Processing CreateTablet for tablet d32df986f4bd4058ae07a90047188d0f (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.394353 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d32df986f4bd4058ae07a90047188d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.405778 10743 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
W20260925 04:54:35.405799 10889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:35.405930 10743 ts_tablet_manager.cc:1397] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.002s
I20260925 04:54:35.406922 10744 ts_tablet_manager.cc:1918] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.406881 10743 raft_consensus.cc:348] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.407121 10743 raft_consensus.cc:374] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.407259 10744 log.cc:1196] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/24c83b2ba7cd4a8eb90d338252051389
I20260925 04:54:35.407263 10743 raft_consensus.cc:729] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.407536 10743 consensus_queue.cc:260] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.408017 10744 ts_tablet_manager.cc:1939] T 24c83b2ba7cd4a8eb90d338252051389 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
W20260925 04:54:35.408807 10886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:35.409436 10586 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.409883 10747 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
W20260925 04:54:35.409904 10586 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 689a7134c47543feaf5c453171ecb75a consensus state has no leader
I20260925 04:54:35.410049 10747 ts_tablet_manager.cc:1397] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.001s
I20260925 04:54:35.411089 10747 raft_consensus.cc:348] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.411276 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 24c83b2ba7cd4a8eb90d338252051389 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.411347 10747 raft_consensus.cc:374] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.411427 10747 raft_consensus.cc:729] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.411726 10747 consensus_queue.cc:260] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.413815 10744 tablet_replica.cc:330] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.414100 10744 raft_consensus.cc:2229] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.414239 10747 ts_tablet_manager.cc:1428] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260925 04:54:35.415007 10747 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.416986 10744 raft_consensus.cc:2258] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.417430 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet d32df986f4bd4058ae07a90047188d0f from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.417817 10744 ts_tablet_manager.cc:1905] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.418251 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet a1f4f9f54ac44dc28629fabc0d2d4d95 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.420135 10743 ts_tablet_manager.cc:1428] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260925 04:54:35.420621 10743 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.422446 10584 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.422624 10747 tablet_bootstrap.cc:654] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.424281 10796 server_base.cc:1034] running on GCE node
I20260925 04:54:35.425119 10745 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.425316 10745 ts_tablet_manager.cc:1397] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.004s
I20260925 04:54:35.425823 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet a1f4f9f54ac44dc28629fabc0d2d4d95
I20260925 04:54:35.426196 10586 catalog_manager.cc:6565] ReplaceTablet: tablet a1f4f9f54ac44dc28629fabc0d2d4d95 deleted and replaced by tablet 099566cef609462f8bcdbebe92862be1
I20260925 04:54:35.426120 10745 raft_consensus.cc:348] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.426460 10745 raft_consensus.cc:374] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.426585 10745 raft_consensus.cc:729] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.426831 10745 consensus_queue.cc:260] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.428548 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 099566cef609462f8bcdbebe92862be1) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.428949 10741 tablet_replica.cc:330] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.429171 10741 raft_consensus.cc:2229] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.429246 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 099566cef609462f8bcdbebe92862be1) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.429342 10741 raft_consensus.cc:2258] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.429486 10746 tablet_replica.cc:330] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.429664 10746 raft_consensus.cc:2229] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.429840 10746 raft_consensus.cc:2258] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.429872 10741 ts_tablet_manager.cc:1905] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.430325 10746 ts_tablet_manager.cc:1905] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.430992 10743 tablet_bootstrap.cc:654] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.430986 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet d32df986f4bd4058ae07a90047188d0f
I20260925 04:54:35.431391 10587 catalog_manager.cc:6565] ReplaceTablet: tablet d32df986f4bd4058ae07a90047188d0f deleted and replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801
I20260925 04:54:35.431943 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.432560 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.434573 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.437336 10587 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d12f6ea5d4c42569a19f6013b616439 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.437569 10741 ts_tablet_manager.cc:1918] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.437613 10746 ts_tablet_manager.cc:1918] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.437711 10741 log.cc:1196] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/a1f4f9f54ac44dc28629fabc0d2d4d95
I20260925 04:54:35.437842 10746 log.cc:1196] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/a1f4f9f54ac44dc28629fabc0d2d4d95
I20260925 04:54:35.438139 10741 ts_tablet_manager.cc:1939] T a1f4f9f54ac44dc28629fabc0d2d4d95 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.438274 10746 ts_tablet_manager.cc:1939] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.439149 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.439244 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.439446 10745 ts_tablet_manager.cc:1428] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
W20260925 04:54:35.439880 10891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:35.440991 10745 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
W20260925 04:54:35.441648 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet d32df986f4bd4058ae07a90047188d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d32df986f4bd4058ae07a90047188d0f already in progress: creating tablet
I20260925 04:54:35.443150 10743 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.443135 10796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:35.443352 10743 ts_tablet_manager.cc:1397] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.004s
I20260925 04:54:35.444020 10743 raft_consensus.cc:348] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.444257 10743 raft_consensus.cc:374] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.444344 10743 raft_consensus.cc:729] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.444585 10743 consensus_queue.cc:260] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.445034 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 099566cef609462f8bcdbebe92862be1 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.445436 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099566cef609462f8bcdbebe92862be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.445573 10121 tablet_service.cc:1467] Processing CreateTablet for tablet 099566cef609462f8bcdbebe92862be1 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.445757 10743 ts_tablet_manager.cc:1428] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:35.446018 10743 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.446527 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099566cef609462f8bcdbebe92862be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.447072 10745 tablet_bootstrap.cc:654] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.447459 10743 tablet_bootstrap.cc:654] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.455400 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 099566cef609462f8bcdbebe92862be1 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 04:54:35.455518 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet d32df986f4bd4058ae07a90047188d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d32df986f4bd4058ae07a90047188d0f already in progress: creating tablet
I20260925 04:54:35.455834 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099566cef609462f8bcdbebe92862be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.456136 10743 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.456343 10743 ts_tablet_manager.cc:1397] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260925 04:54:35.456879 10747 tablet_bootstrap.cc:492] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.457083 10747 ts_tablet_manager.cc:1397] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.001s
I20260925 04:54:35.457194 10743 raft_consensus.cc:348] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.457439 10743 raft_consensus.cc:374] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.457551 10743 raft_consensus.cc:729] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.457991 10747 raft_consensus.cc:348] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.458276 10747 raft_consensus.cc:374] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.458211 10743 consensus_queue.cc:260] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.458405 10747 raft_consensus.cc:729] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.458707 10747 consensus_queue.cc:260] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.459406 10747 ts_tablet_manager.cc:1428] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:35.459734 10747 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.459031 10743 ts_tablet_manager.cc:1428] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.460374 10743 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.461694 10747 tablet_bootstrap.cc:654] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.462836 10743 tablet_bootstrap.cc:654] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.463081 10796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:35.463644 10744 ts_tablet_manager.cc:1918] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.463791 10744 log.cc:1196] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/3b6d49115f2f4a7985ec552e8f01f385
I20260925 04:54:35.464149 10744 ts_tablet_manager.cc:1939] T 3b6d49115f2f4a7985ec552e8f01f385 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.465188 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet a1f4f9f54ac44dc28629fabc0d2d4d95 with delete_type TABLET_DATA_DELETED (replaced by tablet 099566cef609462f8bcdbebe92862be1) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.465365 10745 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.465533 10745 ts_tablet_manager.cc:1397] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260925 04:54:35.465799 10584 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]). Expected version 1 got 0
I20260925 04:54:35.466240 10745 raft_consensus.cc:348] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.466532 10745 raft_consensus.cc:374] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.466607 10745 raft_consensus.cc:729] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.466827 10745 consensus_queue.cc:260] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.468014 10745 ts_tablet_manager.cc:1428] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:35.468632 10745 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.470832 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 3b6d49115f2f4a7985ec552e8f01f385 (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]) successfully deleted
I20260925 04:54:35.470860 10586 catalog_manager.cc:5587] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.471856 10745 tablet_bootstrap.cc:654] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.472774 10744 tablet_replica.cc:330] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.472939 10744 raft_consensus.cc:2229] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.473138 10744 raft_consensus.cc:2258] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.473726 10584 catalog_manager.cc:5587] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.473796 10744 ts_tablet_manager.cc:1905] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.477663 10584 catalog_manager.cc:5587] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.478716 10584 catalog_manager.cc:5587] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.480664 10587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 3d12f6ea5d4c42569a19f6013b616439
I20260925 04:54:35.480762 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.481098 10587 catalog_manager.cc:6565] ReplaceTablet: tablet 3d12f6ea5d4c42569a19f6013b616439 deleted and replaced by tablet e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:35.481207 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b36b06ac9bb460c8df0f9f175bcb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.481241 10743 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.481420 10743 ts_tablet_manager.cc:1397] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260925 04:54:35.482363 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 with delete_type TABLET_DATA_DELETED (replaced by tablet e6e71bd63ef24c7aa8d7dc4788cd871f) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.482262 10743 raft_consensus.cc:348] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.482537 10743 raft_consensus.cc:374] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.482622 10743 raft_consensus.cc:729] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.482954 10743 consensus_queue.cc:260] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.483767 10743 ts_tablet_manager.cc:1428] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:35.484072 10743 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.484637 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 with delete_type TABLET_DATA_DELETED (replaced by tablet e6e71bd63ef24c7aa8d7dc4788cd871f) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.484902 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.485126 10741 tablet_replica.cc:330] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.485141 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.485312 10741 raft_consensus.cc:2229] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.485502 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b36b06ac9bb460c8df0f9f175bcb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.487013 10741 raft_consensus.cc:2258] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.489184 10741 ts_tablet_manager.cc:1905] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.475575 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.490736 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b36b06ac9bb460c8df0f9f175bcb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.492427 10744 ts_tablet_manager.cc:1918] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.492532 10744 log.cc:1196] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.492898 10744 ts_tablet_manager.cc:1939] T 64f2472995cf460899483e7ee0abfd71 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.482182 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 with delete_type TABLET_DATA_DELETED (replaced by tablet e6e71bd63ef24c7aa8d7dc4788cd871f) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.493934 10744 tablet_replica.cc:330] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.494129 10744 raft_consensus.cc:2229] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:35.494385 10744 pending_rounds.cc:62] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Trying to abort 1 pending ops.
I20260925 04:54:35.494496 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 64f2472995cf460899483e7ee0abfd71 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
W20260925 04:54:35.494763 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet d32df986f4bd4058ae07a90047188d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d32df986f4bd4058ae07a90047188d0f already in progress: creating tablet
I20260925 04:54:35.494793 10796 hybrid_clock.cc:648] HybridClock initialized: now 1790312075494664 us; error 91 us; skew 500 ppm
I20260925 04:54:35.495252 10796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260925 04:54:35.498687 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 3d12f6ea5d4c42569a19f6013b616439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d12f6ea5d4c42569a19f6013b616439 already in progress: creating tablet
I20260925 04:54:35.498705 10744 pending_rounds.cc:68] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118258727948288 op_type: NO_OP noop_request { }
I20260925 04:54:35.498858 10744 raft_consensus.cc:2866] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:35.499612 10744 raft_consensus.cc:2258] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.499737 10743 tablet_bootstrap.cc:654] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.500355 10119 tablet_service.cc:1467] Processing CreateTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.500797 10741 ts_tablet_manager.cc:1918] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.500823 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e71bd63ef24c7aa8d7dc4788cd871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.500921 10741 log.cc:1196] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/3d12f6ea5d4c42569a19f6013b616439
I20260925 04:54:35.501121 10396 tablet_service.cc:1467] Processing CreateTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.501282 10741 ts_tablet_manager.cc:1939] T 3d12f6ea5d4c42569a19f6013b616439 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.501533 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e71bd63ef24c7aa8d7dc4788cd871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.502518 10741 tablet_replica.cc:330] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.502647 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.502712 10741 raft_consensus.cc:2229] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.502846 10741 raft_consensus.cc:2258] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.503481 10741 ts_tablet_manager.cc:1905] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.510692 10260 tablet_service.cc:1467] Processing CreateTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.511227 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6e71bd63ef24c7aa8d7dc4788cd871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.512389 10747 tablet_bootstrap.cc:492] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.513710 10744 ts_tablet_manager.cc:1905] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.513952 10747 ts_tablet_manager.cc:1397] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260925 04:54:35.519486 10743 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.519629 10743 ts_tablet_manager.cc:1397] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260925 04:54:35.520323 10747 raft_consensus.cc:348] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.520330 10743 raft_consensus.cc:348] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.521028 10743 raft_consensus.cc:374] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.521150 10743 raft_consensus.cc:729] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
W20260925 04:54:35.521719 10579 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc -> Peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Couldn't send request to peer 37499e1d150b41169507d4dd098579b5. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 04:54:35.521704 10743 consensus_queue.cc:260] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.522928 10743 ts_tablet_manager.cc:1428] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.523195 10743 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.524796 10743 tablet_bootstrap.cc:654] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.525707 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.526765 10741 ts_tablet_manager.cc:1918] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.526902 10741 log.cc:1196] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.527210 10741 ts_tablet_manager.cc:1939] T 64f2472995cf460899483e7ee0abfd71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.527987 10741 tablet_replica.cc:330] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.528075 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 64f2472995cf460899483e7ee0abfd71 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.528154 10741 raft_consensus.cc:2229] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.528306 10741 raft_consensus.cc:2258] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.528955 10741 ts_tablet_manager.cc:1905] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.529910 10796 webserver.cc:460] Webserver started at http://127.9.81.190:33381/ using document root <none> and password file <none>
I20260925 04:54:35.530910 10796 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:35.531080 10796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:35.531524 10747 raft_consensus.cc:374] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.531637 10747 raft_consensus.cc:729] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.531908 10747 consensus_queue.cc:260] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.533886 10741 ts_tablet_manager.cc:1918] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.534000 10741 log.cc:1196] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/d32df986f4bd4058ae07a90047188d0f
I20260925 04:54:35.534392 10741 ts_tablet_manager.cc:1939] T d32df986f4bd4058ae07a90047188d0f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.535087 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet d32df986f4bd4058ae07a90047188d0f (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.535969 10743 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.536115 10743 ts_tablet_manager.cc:1397] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260925 04:54:35.537436 10747 ts_tablet_manager.cc:1428] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260925 04:54:35.536854 10743 raft_consensus.cc:348] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.537554 10743 raft_consensus.cc:374] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.537629 10743 raft_consensus.cc:729] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.537777 10747 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.537832 10743 consensus_queue.cc:260] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.538304 10743 ts_tablet_manager.cc:1428] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:35.538578 10743 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.540119 10743 tablet_bootstrap.cc:654] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.537398 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet e6e71bd63ef24c7aa8d7dc4788cd871f from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.544729 10747 tablet_bootstrap.cc:654] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.545717 10745 tablet_bootstrap.cc:492] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.545868 10745 ts_tablet_manager.cc:1397] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.077s user 0.001s sys 0.012s
I20260925 04:54:35.547223 10745 raft_consensus.cc:348] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.547458 10745 raft_consensus.cc:374] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.547566 10745 raft_consensus.cc:729] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.547783 10745 consensus_queue.cc:260] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.549826 10745 ts_tablet_manager.cc:1428] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260925 04:54:35.550104 10745 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.552239 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d12f6ea5d4c42569a19f6013b616439 with delete_type TABLET_DATA_DELETED (replaced by tablet e6e71bd63ef24c7aa8d7dc4788cd871f) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.552525 10746 tablet_replica.cc:330] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.552711 10746 raft_consensus.cc:2229] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.552840 10746 raft_consensus.cc:2258] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.553483 10746 ts_tablet_manager.cc:1905] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.557711 10745 tablet_bootstrap.cc:654] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.558738 10744 ts_tablet_manager.cc:1918] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:35.558866 10744 log.cc:1196] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/a1f4f9f54ac44dc28629fabc0d2d4d95
I20260925 04:54:35.559813 10746 ts_tablet_manager.cc:1918] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.559883 10744 ts_tablet_manager.cc:1939] T a1f4f9f54ac44dc28629fabc0d2d4d95 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.560055 10746 log.cc:1196] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/3d12f6ea5d4c42569a19f6013b616439
I20260925 04:54:35.560478 10746 ts_tablet_manager.cc:1939] T 3d12f6ea5d4c42569a19f6013b616439 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.560840 10744 tablet_replica.cc:330] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.561055 10744 raft_consensus.cc:2229] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.561221 10744 raft_consensus.cc:2258] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.561311 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet a1f4f9f54ac44dc28629fabc0d2d4d95 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.563208 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.564023 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:35.564571 10586 catalog_manager.cc:6565] ReplaceTablet: tablet e6e71bd63ef24c7aa8d7dc4788cd871f deleted and replaced by tablet 0565c53e13ca440facf15742afba3271
I20260925 04:54:35.564652 10744 ts_tablet_manager.cc:1905] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.567548 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:49620
W20260925 04:54:35.568216 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet e6e71bd63ef24c7aa8d7dc4788cd871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e71bd63ef24c7aa8d7dc4788cd871f already in progress: creating tablet
I20260925 04:54:35.569995 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.570685 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:46148
W20260925 04:54:35.571378 10007 hms_client.cc:305] Time spent drop HMS table: real 2.647s user 0.000s sys 0.000s
I20260925 04:54:35.571769 9951 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=27c0608f6eee489492ab4e3bb85230ba]
W20260925 04:54:35.572078 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet e6e71bd63ef24c7aa8d7dc4788cd871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e71bd63ef24c7aa8d7dc4788cd871f already in progress: creating tablet
I20260925 04:54:35.572198 9951 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 3) took 6236 ms. Trace:
I20260925 04:54:35.572330 9951 rpcz_store.cc:276] 0925 04:54:29.335667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.336246 (+ 579us) service_pool.cc:227] Handling call
0925 04:54:30.343192 (+1006946us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.343740 (+ 548us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:32.082457 (+1738717us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:32.083377 (+ 920us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.083380 (+ 3us) write_op.cc:454] Released schema lock
0925 04:54:32.083658 (+ 278us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:35.572147 (+3488489us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:32.083235 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:32.083252 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.083258 (+ 6us) write_op.cc:454] Released schema lock
0925 04:54:32.083262 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1855033,"Hive Metastore.run_cpu_time_us":861,"Hive Metastore.run_wall_time_us":3371206,"child_traces":[["op",{}]]}
I20260925 04:54:35.572782 10747 tablet_bootstrap.cc:492] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.572914 10747 ts_tablet_manager.cc:1397] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
I20260925 04:54:35.574199 10747 raft_consensus.cc:348] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.574479 10747 raft_consensus.cc:374] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.574577 10747 raft_consensus.cc:729] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
W20260925 04:54:35.574856 10472 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.189:45475)
I20260925 04:54:35.574834 10747 consensus_queue.cc:260] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.575599 10747 ts_tablet_manager.cc:1428] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.575863 10747 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.576704 10745 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.576849 10745 ts_tablet_manager.cc:1397] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260925 04:54:35.577477 10747 tablet_bootstrap.cc:654] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.577651 10745 raft_consensus.cc:348] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.577898 10745 raft_consensus.cc:374] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.577965 10745 raft_consensus.cc:729] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.578192 10745 consensus_queue.cc:260] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.579265 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 0565c53e13ca440facf15742afba3271 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.579707 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0565c53e13ca440facf15742afba3271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.579707 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 0565c53e13ca440facf15742afba3271 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.580039 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0565c53e13ca440facf15742afba3271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.587855 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 0565c53e13ca440facf15742afba3271 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.588225 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0565c53e13ca440facf15742afba3271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.593523 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.593812 10746 tablet_replica.cc:330] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.593971 10746 raft_consensus.cc:2229] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.594152 10746 raft_consensus.cc:2258] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.594982 10796 fs_manager.cc:709] Time spent opening directory manager: real 0.061s user 0.004s sys 0.002s
I20260925 04:54:35.596032 10746 ts_tablet_manager.cc:1905] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.601596 10745 ts_tablet_manager.cc:1428] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.025s user 0.000s sys 0.002s
I20260925 04:54:35.601933 10745 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.602056 10746 ts_tablet_manager.cc:1918] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.602213 10746 log.cc:1196] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.602623 10746 ts_tablet_manager.cc:1939] T 64f2472995cf460899483e7ee0abfd71 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.603663 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 64f2472995cf460899483e7ee0abfd71 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.604543 10745 tablet_bootstrap.cc:654] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.608114 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f2472995cf460899483e7ee0abfd71 with delete_type TABLET_DATA_DELETED (replaced by tablet d32df986f4bd4058ae07a90047188d0f) from {username='slave'} at 127.0.0.1:46148
W20260925 04:54:35.608723 10580 catalog_manager.cc:4808] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 64f2472995cf460899483e7ee0abfd71 because the tablet was not found. No further retry: Not found: Tablet not found: 64f2472995cf460899483e7ee0abfd71
I20260925 04:54:35.609846 10912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:35.619832 10744 ts_tablet_manager.cc:1918] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.620019 10744 log.cc:1196] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/3d12f6ea5d4c42569a19f6013b616439
I20260925 04:54:35.620467 10744 ts_tablet_manager.cc:1939] T 3d12f6ea5d4c42569a19f6013b616439 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.624392 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 099566cef609462f8bcdbebe92862be1 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.624850 10747 tablet_bootstrap.cc:492] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.625048 10747 ts_tablet_manager.cc:1397] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.018s
I20260925 04:54:35.625837 10747 raft_consensus.cc:348] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.626082 10747 raft_consensus.cc:374] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.626169 10747 raft_consensus.cc:729] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.626402 10747 consensus_queue.cc:260] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.627315 10796 fs_manager.cc:725] Time spent opening block manager: real 0.027s user 0.002s sys 0.000s
I20260925 04:54:35.627678 10747 ts_tablet_manager.cc:1428] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:35.627965 10747 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.627507 10796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
uuid: "37499e1d150b41169507d4dd098579b5"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:35.628927 10796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:35.630815 10747 tablet_bootstrap.cc:654] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.633860 10745 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.634035 10745 ts_tablet_manager.cc:1397] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.003s
I20260925 04:54:35.638288 10745 raft_consensus.cc:348] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.638537 10745 raft_consensus.cc:374] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.638648 10745 raft_consensus.cc:729] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.641726 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 3d12f6ea5d4c42569a19f6013b616439 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.642340 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 099566cef609462f8bcdbebe92862be1
W20260925 04:54:35.643132 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet e6e71bd63ef24c7aa8d7dc4788cd871f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e71bd63ef24c7aa8d7dc4788cd871f already in progress: creating tablet
I20260925 04:54:35.643452 10745 consensus_queue.cc:260] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.643569 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 099566cef609462f8bcdbebe92862be1 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e) from {username='slave'} at 127.0.0.1:46148
W20260925 04:54:35.644229 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 099566cef609462f8bcdbebe92862be1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 099566cef609462f8bcdbebe92862be1 already in progress: creating tablet
I20260925 04:54:35.645450 10745 ts_tablet_manager.cc:1428] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260925 04:54:35.645736 10745 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.654695 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 099566cef609462f8bcdbebe92862be1 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.655226 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:54288
W20260925 04:54:35.655397 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 099566cef609462f8bcdbebe92862be1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 099566cef609462f8bcdbebe92862be1 already in progress: creating tablet
I20260925 04:54:35.655494 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 099566cef609462f8bcdbebe92862be1 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.655709 10744 tablet_replica.cc:330] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.655804 10741 tablet_replica.cc:330] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.655889 10744 raft_consensus.cc:2229] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.656028 10741 raft_consensus.cc:2229] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.656075 10744 raft_consensus.cc:2258] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.656191 10741 raft_consensus.cc:2258] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.656818 10744 ts_tablet_manager.cc:1905] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.656834 10741 ts_tablet_manager.cc:1905] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.657585 10747 tablet_bootstrap.cc:492] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.661471 10745 tablet_bootstrap.cc:654] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.661738 10747 ts_tablet_manager.cc:1397] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.034s user 0.014s sys 0.013s
I20260925 04:54:35.662561 10747 raft_consensus.cc:348] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.662919 10747 raft_consensus.cc:374] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.663508 10747 raft_consensus.cc:729] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.663822 10747 consensus_queue.cc:260] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.664318 10119 tablet_service.cc:1467] Processing CreateTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.665761 10741 ts_tablet_manager.cc:1918] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.666116 10741 log.cc:1196] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/099566cef609462f8bcdbebe92862be1
I20260925 04:54:35.666918 10741 ts_tablet_manager.cc:1939] T 099566cef609462f8bcdbebe92862be1 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.668074 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.667614 10394 tablet_service.cc:1467] Processing CreateTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.669793 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.671365 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 099566cef609462f8bcdbebe92862be1 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.673389 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 099566cef609462f8bcdbebe92862be1 deleted and replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:35.665162 10747 ts_tablet_manager.cc:1428] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:35.667143 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet d32df986f4bd4058ae07a90047188d0f with delete_type TABLET_DATA_DELETED (replaced by tablet 0b36b06ac9bb460c8df0f9f175bcb801) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.673801 10744 ts_tablet_manager.cc:1918] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.673856 10746 tablet_replica.cc:330] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.673920 10744 log.cc:1196] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/d32df986f4bd4058ae07a90047188d0f
I20260925 04:54:35.673874 10260 tablet_service.cc:1467] Processing CreateTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.674047 10746 raft_consensus.cc:2229] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.674196 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.674207 10746 raft_consensus.cc:2258] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.674297 10744 ts_tablet_manager.cc:1939] T d32df986f4bd4058ae07a90047188d0f P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.674736 10747 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.674818 10746 ts_tablet_manager.cc:1905] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.675863 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet d32df986f4bd4058ae07a90047188d0f (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.681087 10747 tablet_bootstrap.cc:654] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.682454 10746 ts_tablet_manager.cc:1918] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.682602 10746 log.cc:1196] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/d32df986f4bd4058ae07a90047188d0f
I20260925 04:54:35.682958 10746 ts_tablet_manager.cc:1939] T d32df986f4bd4058ae07a90047188d0f P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.683805 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet d32df986f4bd4058ae07a90047188d0f (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.685163 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet 0b36b06ac9bb460c8df0f9f175bcb801 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.688396 10592 catalog_manager.cc:3411] renamed table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04] in HMS: new name default.table_48a023979ead4432a298d53c804329da
I20260925 04:54:35.688983 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 0b36b06ac9bb460c8df0f9f175bcb801 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.690364 10587 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_273e0dfb03e648e4b9fd3a8abf07a709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:35.692799 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 0b36b06ac9bb460c8df0f9f175bcb801
I20260925 04:54:35.693200 10584 master_service.cc:946] ReplaceTablet: received request to replace tablet 0565c53e13ca440facf15742afba3271 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.693540 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.694022 10586 catalog_manager.cc:6565] ReplaceTablet: tablet 0b36b06ac9bb460c8df0f9f175bcb801 deleted and replaced by tablet cc10d812f78a47258ed9b6e5726e54fb
I20260925 04:54:35.694396 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:54288
W20260925 04:54:35.694619 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 0b36b06ac9bb460c8df0f9f175bcb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b36b06ac9bb460c8df0f9f175bcb801 already in progress: creating tablet
W20260925 04:54:35.695088 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 0b36b06ac9bb460c8df0f9f175bcb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b36b06ac9bb460c8df0f9f175bcb801 already in progress: creating tablet
I20260925 04:54:35.701529 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 0565c53e13ca440facf15742afba3271
I20260925 04:54:35.702034 10584 catalog_manager.cc:6565] ReplaceTablet: tablet 0565c53e13ca440facf15742afba3271 deleted and replaced by tablet 84148597a8b74a0a957c5fc9fd716429
I20260925 04:54:35.702625 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.703399 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.703498 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.703802 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:49620
W20260925 04:54:35.704241 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 0565c53e13ca440facf15742afba3271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0565c53e13ca440facf15742afba3271 already in progress: creating tablet
W20260925 04:54:35.704281 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 0565c53e13ca440facf15742afba3271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0565c53e13ca440facf15742afba3271 already in progress: creating tablet
W20260925 04:54:35.704751 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 0565c53e13ca440facf15742afba3271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0565c53e13ca440facf15742afba3271 already in progress: creating tablet
W20260925 04:54:35.706897 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 0b36b06ac9bb460c8df0f9f175bcb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b36b06ac9bb460c8df0f9f175bcb801 already in progress: creating tablet
I20260925 04:54:35.708019 10747 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.708209 10747 ts_tablet_manager.cc:1397] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.007s
I20260925 04:54:35.708992 10747 raft_consensus.cc:348] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.709321 10747 raft_consensus.cc:374] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.709391 10747 raft_consensus.cc:729] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.709630 10747 consensus_queue.cc:260] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.710631 10119 tablet_service.cc:1467] Processing CreateTablet for tablet cc10d812f78a47258ed9b6e5726e54fb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.710839 10395 tablet_service.cc:1467] Processing CreateTablet for tablet cc10d812f78a47258ed9b6e5726e54fb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.711118 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc10d812f78a47258ed9b6e5726e54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.711200 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc10d812f78a47258ed9b6e5726e54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.711244 10747 ts_tablet_manager.cc:1428] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:35.716351 10260 tablet_service.cc:1467] Processing CreateTablet for tablet cc10d812f78a47258ed9b6e5726e54fb (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.716734 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc10d812f78a47258ed9b6e5726e54fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.721571 10747 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.721969 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 099566cef609462f8bcdbebe92862be1 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.722241 10746 tablet_replica.cc:330] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.722473 10746 raft_consensus.cc:2229] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.722702 10746 raft_consensus.cc:2258] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.722932 10743 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.723058 10743 ts_tablet_manager.cc:1397] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.185s user 0.027s sys 0.044s
I20260925 04:54:35.723305 10747 tablet_bootstrap.cc:654] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.723836 10743 raft_consensus.cc:348] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.724057 10743 raft_consensus.cc:374] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.724155 10743 raft_consensus.cc:729] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.724388 10743 consensus_queue.cc:260] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.724885 10743 ts_tablet_manager.cc:1428] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:35.725549 10746 ts_tablet_manager.cc:1905] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.727355 10552 raft_consensus.cc:482] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:35.727525 10552 raft_consensus.cc:504] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.728116 10552 leader_election.cc:288] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:35.728736 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689a7134c47543feaf5c453171ecb75a" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:35.729058 10144 raft_consensus.cc:2454] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:35.729591 10218 leader_election.cc:302] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:35.730551 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689a7134c47543feaf5c453171ecb75a" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:35.730849 10417 raft_consensus.cc:2454] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:35.731693 10552 raft_consensus.cc:2781] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:35.731827 10552 raft_consensus.cc:482] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:35.731946 10552 raft_consensus.cc:3037] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:35.735419 10552 raft_consensus.cc:504] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.736719 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689a7134c47543feaf5c453171ecb75a" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:35.737015 10144 raft_consensus.cc:3037] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:35.738969 10746 ts_tablet_manager.cc:1918] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.739080 10746 log.cc:1196] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/099566cef609462f8bcdbebe92862be1
I20260925 04:54:35.739423 10746 ts_tablet_manager.cc:1939] T 099566cef609462f8bcdbebe92862be1 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.740316 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 099566cef609462f8bcdbebe92862be1 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.740621 10144 raft_consensus.cc:2454] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:35.741297 10218 leader_election.cc:302] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:35.744498 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 84148597a8b74a0a957c5fc9fd716429 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.745064 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84148597a8b74a0a957c5fc9fd716429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.745308 10743 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.745335 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 84148597a8b74a0a957c5fc9fd716429 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.746344 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84148597a8b74a0a957c5fc9fd716429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.747014 10743 tablet_bootstrap.cc:654] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.750211 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.754696 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "689a7134c47543feaf5c453171ecb75a" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:35.754974 10417 raft_consensus.cc:3037] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:35.758852 10417 raft_consensus.cc:2454] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:35.759701 10552 leader_election.cc:288] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:35.760280 10552 raft_consensus.cc:2781] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:35.760793 10552 raft_consensus.cc:686] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:35.761682 10552 consensus_queue.cc:237] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.763274 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 84148597a8b74a0a957c5fc9fd716429 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.765641 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84148597a8b74a0a957c5fc9fd716429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.766772 10741 tablet_replica.cc:330] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.767436 10741 raft_consensus.cc:2229] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.773263 10741 raft_consensus.cc:2258] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.778735 10741 ts_tablet_manager.cc:1905] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.786454 10745 tablet_bootstrap.cc:492] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.786685 10745 ts_tablet_manager.cc:1397] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.141s user 0.003s sys 0.020s
I20260925 04:54:35.787495 10745 raft_consensus.cc:348] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.787738 10745 raft_consensus.cc:374] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.787833 10745 raft_consensus.cc:729] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.788089 10745 consensus_queue.cc:260] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.789501 10745 ts_tablet_manager.cc:1428] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:35.789815 10745 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.793607 10745 tablet_bootstrap.cc:654] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:35.796820 10218 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.81.129:36933, user_credentials={real_user=slave}} blocked reactor thread for 55593.2us
I20260925 04:54:35.798241 10743 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.798460 10743 ts_tablet_manager.cc:1397] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.000s
I20260925 04:54:35.799175 10743 raft_consensus.cc:348] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.799526 10743 raft_consensus.cc:374] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.799662 10743 raft_consensus.cc:729] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.799993 10743 consensus_queue.cc:260] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.800595 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 099566cef609462f8bcdbebe92862be1 with delete_type TABLET_DATA_DELETED (replaced by tablet e7ceefe8a6894cc78cf3d7d5f3433c8e) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.800845 10744 tablet_replica.cc:330] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.801050 10744 raft_consensus.cc:2229] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.801225 10744 raft_consensus.cc:2258] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.801410 10743 ts_tablet_manager.cc:1428] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 04:54:35.801837 10744 ts_tablet_manager.cc:1905] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.802119 10743 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.808338 10744 ts_tablet_manager.cc:1918] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.808470 10744 log.cc:1196] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/099566cef609462f8bcdbebe92862be1
I20260925 04:54:35.808771 10744 ts_tablet_manager.cc:1939] T 099566cef609462f8bcdbebe92862be1 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.809837 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 099566cef609462f8bcdbebe92862be1 (table default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:35.815446 10586 master_service.cc:946] ReplaceTablet: received request to replace tablet bd6a76ccc1034b538cb5354ac70e3d71 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.816182 10584 catalog_manager.cc:5495] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130). New cstate: current_term: 1 leader_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } health_report { overall_health: HEALTHY } } }
I20260925 04:54:35.816660 10584 catalog_manager.cc:5587] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869) does not have the latest schema for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]). Expected version 1 got 0
I20260925 04:54:35.817710 10743 tablet_bootstrap.cc:654] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.818578 10741 ts_tablet_manager.cc:1918] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.820359 10741 log.cc:1196] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/0b36b06ac9bb460c8df0f9f175bcb801
I20260925 04:54:35.820839 10741 ts_tablet_manager.cc:1939] T 0b36b06ac9bb460c8df0f9f175bcb801 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.822294 10586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet bd6a76ccc1034b538cb5354ac70e3d71
I20260925 04:54:35.822729 10586 catalog_manager.cc:6565] ReplaceTablet: tablet bd6a76ccc1034b538cb5354ac70e3d71 deleted and replaced by tablet 590c902ec8ea41679146d82b058e01e3
I20260925 04:54:35.824116 10747 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.824271 10747 ts_tablet_manager.cc:1397] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.103s user 0.020s sys 0.031s
I20260925 04:54:35.825539 10747 raft_consensus.cc:348] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.825845 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 with delete_type TABLET_DATA_DELETED (replaced by tablet 590c902ec8ea41679146d82b058e01e3) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.825742 10747 raft_consensus.cc:374] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.826087 10747 raft_consensus.cc:729] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.826344 10747 consensus_queue.cc:260] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.827370 10747 ts_tablet_manager.cc:1428] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:35.827658 10747 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.829020 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 with delete_type TABLET_DATA_DELETED (replaced by tablet 590c902ec8ea41679146d82b058e01e3) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.829499 10746 tablet_replica.cc:330] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.829752 10746 raft_consensus.cc:2229] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.829921 10746 raft_consensus.cc:2258] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.830921 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.831187 10746 ts_tablet_manager.cc:1905] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.833659 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.836673 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 590c902ec8ea41679146d82b058e01e3 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.836683 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 590c902ec8ea41679146d82b058e01e3 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.837106 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c902ec8ea41679146d82b058e01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.837697 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c902ec8ea41679146d82b058e01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.838909 10746 ts_tablet_manager.cc:1918] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.839082 10746 log.cc:1196] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/bd6a76ccc1034b538cb5354ac70e3d71
I20260925 04:54:35.839464 10746 ts_tablet_manager.cc:1939] T bd6a76ccc1034b538cb5354ac70e3d71 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.841219 10746 tablet_replica.cc:330] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.841463 10746 raft_consensus.cc:2229] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.841634 10746 raft_consensus.cc:2258] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.842057 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 590c902ec8ea41679146d82b058e01e3 (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.842470 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c902ec8ea41679146d82b058e01e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.842597 10746 ts_tablet_manager.cc:1905] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.845243 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet bd6a76ccc1034b538cb5354ac70e3d71 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.846392 10747 tablet_bootstrap.cc:654] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.851855 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet bd6a76ccc1034b538cb5354ac70e3d71 with delete_type TABLET_DATA_DELETED (replaced by tablet 590c902ec8ea41679146d82b058e01e3) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.852257 10744 tablet_replica.cc:330] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.852491 10744 raft_consensus.cc:2229] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.852700 10744 raft_consensus.cc:2258] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.853073 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 0b36b06ac9bb460c8df0f9f175bcb801 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.853507 10741 tablet_replica.cc:330] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.853746 10741 raft_consensus.cc:2229] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.853931 10741 raft_consensus.cc:2258] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.854027 10745 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.854187 10745 ts_tablet_manager.cc:1397] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.012s
I20260925 04:54:35.854434 10746 ts_tablet_manager.cc:1918] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.854553 10746 log.cc:1196] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/0b36b06ac9bb460c8df0f9f175bcb801
I20260925 04:54:35.854907 10746 ts_tablet_manager.cc:1939] T 0b36b06ac9bb460c8df0f9f175bcb801 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.854912 10741 ts_tablet_manager.cc:1905] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.855049 10745 raft_consensus.cc:348] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.855754 10745 raft_consensus.cc:374] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.855865 10745 raft_consensus.cc:729] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.855871 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 0b36b06ac9bb460c8df0f9f175bcb801 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:35.856086 10745 consensus_queue.cc:260] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.858827 10743 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.859011 10743 ts_tablet_manager.cc:1397] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260925 04:54:35.859793 10743 raft_consensus.cc:348] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.860054 10744 ts_tablet_manager.cc:1905] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.860054 10743 raft_consensus.cc:374] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.860245 10743 raft_consensus.cc:729] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.860524 10743 consensus_queue.cc:260] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.861644 10745 ts_tablet_manager.cc:1428] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260925 04:54:35.863163 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.863687 10743 ts_tablet_manager.cc:1428] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 04:54:35.864948 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.866408 10747 tablet_bootstrap.cc:492] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.866554 10747 ts_tablet_manager.cc:1397] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.001s
I20260925 04:54:35.867188 10744 ts_tablet_manager.cc:1918] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.867318 10744 log.cc:1196] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/bd6a76ccc1034b538cb5354ac70e3d71
I20260925 04:54:35.867690 10744 ts_tablet_manager.cc:1939] T bd6a76ccc1034b538cb5354ac70e3d71 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.867539 10747 raft_consensus.cc:348] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.867789 10747 raft_consensus.cc:374] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.867873 10747 raft_consensus.cc:729] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.867892 10743 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.868083 10747 consensus_queue.cc:260] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.868562 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet bd6a76ccc1034b538cb5354ac70e3d71 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.868646 10747 ts_tablet_manager.cc:1428] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:35.868852 10744 tablet_replica.cc:330] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.868959 10747 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.869043 10744 raft_consensus.cc:2229] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.869171 10744 raft_consensus.cc:2258] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.869815 10744 ts_tablet_manager.cc:1905] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.872128 10747 tablet_bootstrap.cc:654] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.873981 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet e6e71bd63ef24c7aa8d7dc4788cd871f with delete_type TABLET_DATA_DELETED (replaced by tablet 0565c53e13ca440facf15742afba3271) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.874240 10746 tablet_replica.cc:330] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.874423 10746 raft_consensus.cc:2229] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.874588 10746 raft_consensus.cc:2258] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.875119 10746 ts_tablet_manager.cc:1905] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.876106 10743 tablet_bootstrap.cc:654] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.880218 10747 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.880359 10747 ts_tablet_manager.cc:1397] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260925 04:54:35.881114 10747 raft_consensus.cc:348] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.881335 10747 raft_consensus.cc:374] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.881458 10747 raft_consensus.cc:729] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.881505 10746 ts_tablet_manager.cc:1918] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.881637 10746 log.cc:1196] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:35.881964 10746 ts_tablet_manager.cc:1939] T e6e71bd63ef24c7aa8d7dc4788cd871f P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.882827 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e6e71bd63ef24c7aa8d7dc4788cd871f (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.885831 10747 consensus_queue.cc:260] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.886765 10744 ts_tablet_manager.cc:1918] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.886900 10744 log.cc:1196] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:35.887225 10744 ts_tablet_manager.cc:1939] T e6e71bd63ef24c7aa8d7dc4788cd871f P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.887755 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet e6e71bd63ef24c7aa8d7dc4788cd871f (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.888253 10745 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.890334 10745 tablet_bootstrap.cc:654] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.890901 10593 catalog_manager.cc:2148] created HMS catalog entry for table [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:35.896580 10747 ts_tablet_manager.cc:1428] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260925 04:54:35.897442 10593 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52548 (request call id 2) took 2930 ms. Trace:
I20260925 04:54:35.897591 10593 rpcz_store.cc:276] 0925 04:54:32.967366 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.968330 (+ 964us) service_pool.cc:227] Handling call
0925 04:54:34.973661 (+2005331us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:34.974132 (+ 471us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:35.890853 (+916721us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:35.897182 (+ 6329us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:35.897316 (+ 134us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:35.897409 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:35.891624 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:35.891737 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:35.891745 (+ 8us) write_op.cc:435] Acquired schema lock
0925 04:54:35.891747 (+ 2us) tablet.cc:660] Decoding operations
0925 04:54:35.891838 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:35.891870 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:35.891875 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:35.891950 (+ 75us) tablet.cc:699] Row locks acquired
0925 04:54:35.891953 (+ 3us) write_op.cc:260] PREPARE: finished
0925 04:54:35.891986 (+ 33us) write_op.cc:270] Start()
0925 04:54:35.892020 (+ 34us) write_op.cc:276] Timestamp: P: 1790312075891962 usec, L: 0
0925 04:54:35.892024 (+ 4us) op_driver.cc:331] REPLICATION: starting
0925 04:54:35.892224 (+ 200us) log.cc:842] Serialized 432 byte log entry
0925 04:54:35.895453 (+ 3229us) op_driver.cc:444] REPLICATION: finished
0925 04:54:35.895620 (+ 167us) write_op.cc:301] APPLY: starting
0925 04:54:35.895634 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:35.895688 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:35.895721 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:35.895825 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:35.895861 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:35.895867 (+ 6us) write_op.cc:312] APPLY: finished
0925 04:54:35.895940 (+ 73us) log.cc:842] Serialized 28 byte log entry
0925 04:54:35.896035 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:35.896053 (+ 18us) write_op.cc:454] Released schema lock
0925 04:54:35.896059 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:35.896117 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:35.896120 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":713906,"Hive Metastore.run_cpu_time_us":286,"Hive Metastore.run_wall_time_us":202448,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":548,"apply.run_wall_time_us":547,"num_ops":2,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":727,"prepare.run_wall_time_us":727,"raft.queue_time_us":995,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":219,"replication_time_us":3410}]]}
I20260925 04:54:35.898609 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.899638 10747 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.902307 10747 tablet_bootstrap.cc:654] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.902534 10746 tablet_replica.cc:330] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.902803 10746 raft_consensus.cc:2229] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.903030 10746 raft_consensus.cc:2258] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.903367 10552 raft_consensus.cc:482] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:35.903632 10746 ts_tablet_manager.cc:1905] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.903533 10552 raft_consensus.cc:504] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.904111 10743 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:35.904268 10743 ts_tablet_manager.cc:1397] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.004s
I20260925 04:54:35.904347 10552 leader_election.cc:288] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
W20260925 04:54:35.907110 10218 leader_election.cc:341] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e6e71bd63ef24c7aa8d7dc4788cd871f
W20260925 04:54:35.907797 10217 leader_election.cc:341] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): Not found: Tablet not found: e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:35.907897 10217 leader_election.cc:302] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9
I20260925 04:54:35.909595 9948 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=b224d52b3fcf402392e92c06fab50ac9]
I20260925 04:54:35.909790 10586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:35.909893 9948 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 6) took 6572 ms. Trace:
I20260925 04:54:35.909996 10586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:35.910005 9948 rpcz_store.cc:276] 0925 04:54:29.337274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.337405 (+ 131us) service_pool.cc:227] Handling call
0925 04:54:30.344336 (+1006931us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.344921 (+ 585us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:32.312964 (+1968043us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:32.313874 (+ 910us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.313878 (+ 4us) write_op.cc:454] Released schema lock
0925 04:54:32.314112 (+ 234us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:35.909862 (+3595750us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:32.313794 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:32.313806 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.313813 (+ 7us) write_op.cc:454] Released schema lock
0925 04:54:32.313819 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":4994728,"Hive Metastore.run_cpu_time_us":439,"Hive Metastore.run_wall_time_us":567904,"child_traces":[["op",{}]]}
I20260925 04:54:35.910283 10746 ts_tablet_manager.cc:1918] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.910393 10746 log.cc:1196] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/0565c53e13ca440facf15742afba3271
I20260925 04:54:35.910799 10746 ts_tablet_manager.cc:1939] T 0565c53e13ca440facf15742afba3271 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.912493 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 0565c53e13ca440facf15742afba3271 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:35.913143 10741 ts_tablet_manager.cc:1918] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.913305 10741 log.cc:1196] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/bd6a76ccc1034b538cb5354ac70e3d71
I20260925 04:54:35.913679 10741 ts_tablet_manager.cc:1939] T bd6a76ccc1034b538cb5354ac70e3d71 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:35.914760 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet bd6a76ccc1034b538cb5354ac70e3d71 (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]) successfully deleted
I20260925 04:54:35.904948 10743 raft_consensus.cc:348] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.917071 10584 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52548:
name: "default.Table_80d05ca86f934088be48a6989b971ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:35.917361 10743 raft_consensus.cc:374] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.917475 10743 raft_consensus.cc:729] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.917629 10552 raft_consensus.cc:2726] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:35.917718 10743 consensus_queue.cc:260] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.918186 10743 ts_tablet_manager.cc:1428] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260925 04:54:35.918466 10743 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:35.919446 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec88d2656214489b9b14f8517b549ad (DEFAULT_TABLE table=default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.919827 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec88d2656214489b9b14f8517b549ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.920290 10743 tablet_bootstrap.cc:654] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.920413 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec88d2656214489b9b14f8517b549ad (DEFAULT_TABLE table=default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.920794 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec88d2656214489b9b14f8517b549ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.924269 10741 tablet_replica.cc:330] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:35.924477 10741 raft_consensus.cc:2229] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.925091 10741 raft_consensus.cc:2258] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.925654 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec88d2656214489b9b14f8517b549ad (DEFAULT_TABLE table=default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.926046 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec88d2656214489b9b14f8517b549ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.926427 10593 master_service.cc:946] ReplaceTablet: received request to replace tablet 590c902ec8ea41679146d82b058e01e3 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.938179 10593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 590c902ec8ea41679146d82b058e01e3
I20260925 04:54:35.938655 10593 catalog_manager.cc:6565] ReplaceTablet: tablet 590c902ec8ea41679146d82b058e01e3 deleted and replaced by tablet 7ec2296f1d414013bb2699ed9fd7d2fc
I20260925 04:54:35.939061 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c902ec8ea41679146d82b058e01e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec2296f1d414013bb2699ed9fd7d2fc) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.939721 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c902ec8ea41679146d82b058e01e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec2296f1d414013bb2699ed9fd7d2fc) from {username='slave'} at 127.0.0.1:54288
W20260925 04:54:35.939860 10580 catalog_manager.cc:4821] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): delete failed for tablet 590c902ec8ea41679146d82b058e01e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 590c902ec8ea41679146d82b058e01e3 already in progress: creating tablet
W20260925 04:54:35.940421 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 590c902ec8ea41679146d82b058e01e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 590c902ec8ea41679146d82b058e01e3 already in progress: creating tablet
I20260925 04:54:35.942106 10260 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c902ec8ea41679146d82b058e01e3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ec2296f1d414013bb2699ed9fd7d2fc) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.946182 10745 tablet_bootstrap.cc:492] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:35.946382 10745 ts_tablet_manager.cc:1397] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.058s user 0.012s sys 0.003s
I20260925 04:54:35.947103 10745 raft_consensus.cc:348] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.947362 10745 raft_consensus.cc:374] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.947434 10745 raft_consensus.cc:729] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.947675 10745 consensus_queue.cc:260] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.948951 10593 master_service.cc:946] ReplaceTablet: received request to replace tablet b85a274b180645fc9ad9678b86bfb706 from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.951467 10741 ts_tablet_manager.cc:1905] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.955296 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.955520 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.955689 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ec2296f1d414013bb2699ed9fd7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.956002 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ec2296f1d414013bb2699ed9fd7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.955391 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (DEFAULT_TABLE table=default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.957029 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ec2296f1d414013bb2699ed9fd7d2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.960367 10593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet b85a274b180645fc9ad9678b86bfb706
I20260925 04:54:35.961068 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet b85a274b180645fc9ad9678b86bfb706 with delete_type TABLET_DATA_DELETED (replaced by tablet 040e836f705e4023905c863618b8248c) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.961248 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet b85a274b180645fc9ad9678b86bfb706 with delete_type TABLET_DATA_DELETED (replaced by tablet 040e836f705e4023905c863618b8248c) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.961339 10746 tablet_replica.cc:330] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:35.961470 10593 catalog_manager.cc:6565] ReplaceTablet: tablet b85a274b180645fc9ad9678b86bfb706 deleted and replaced by tablet 040e836f705e4023905c863618b8248c
I20260925 04:54:35.961580 10746 raft_consensus.cc:2229] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.961757 10746 raft_consensus.cc:2258] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.962726 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet b85a274b180645fc9ad9678b86bfb706 with delete_type TABLET_DATA_DELETED (replaced by tablet 040e836f705e4023905c863618b8248c) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.962997 10744 tablet_replica.cc:330] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.963052 10593 master_service.cc:946] ReplaceTablet: received request to replace tablet e7ceefe8a6894cc78cf3d7d5f3433c8e from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.963155 10744 raft_consensus.cc:2229] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.963340 10744 raft_consensus.cc:2258] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.964334 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.965236 10744 ts_tablet_manager.cc:1905] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.969486 10746 ts_tablet_manager.cc:1905] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:35.975756 10746 ts_tablet_manager.cc:1918] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.977998 10744 ts_tablet_manager.cc:1918] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:35.978183 10744 log.cc:1196] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/b85a274b180645fc9ad9678b86bfb706
I20260925 04:54:35.978659 10744 ts_tablet_manager.cc:1939] T b85a274b180645fc9ad9678b86bfb706 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:35.979719 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet b85a274b180645fc9ad9678b86bfb706 (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]) successfully deleted
W20260925 04:54:35.980432 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet 0b36b06ac9bb460c8df0f9f175bcb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b36b06ac9bb460c8df0f9f175bcb801 already in progress: creating tablet
I20260925 04:54:35.982048 10796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:35.983162 10394 tablet_service.cc:1467] Processing CreateTablet for tablet 040e836f705e4023905c863618b8248c (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.983242 10796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:35.983523 10796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:35.983569 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 040e836f705e4023905c863618b8248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.984485 10746 log.cc:1196] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/b85a274b180645fc9ad9678b86bfb706
I20260925 04:54:35.984855 10746 ts_tablet_manager.cc:1939] T b85a274b180645fc9ad9678b86bfb706 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:35.985719 10593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:35.986176 10593 catalog_manager.cc:6565] ReplaceTablet: tablet e7ceefe8a6894cc78cf3d7d5f3433c8e deleted and replaced by tablet ed3266630f274ef58f1a95fbd5aaf559
I20260925 04:54:35.986425 10593 master_service.cc:946] ReplaceTablet: received request to replace tablet e7ceefe8a6894cc78cf3d7d5f3433c8e from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:35.987370 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e with delete_type TABLET_DATA_DELETED (replaced by tablet ed3266630f274ef58f1a95fbd5aaf559) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:35.987519 10745 ts_tablet_manager.cc:1428] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260925 04:54:35.987937 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet b85a274b180645fc9ad9678b86bfb706 (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]) successfully deleted
I20260925 04:54:35.988221 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e with delete_type TABLET_DATA_DELETED (replaced by tablet ed3266630f274ef58f1a95fbd5aaf559) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:35.989367 10747 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:35.989533 10747 ts_tablet_manager.cc:1397] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.012s
I20260925 04:54:35.990945 10747 raft_consensus.cc:348] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.991284 10747 raft_consensus.cc:374] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:35.991382 10747 raft_consensus.cc:729] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:35.991715 10747 consensus_queue.cc:260] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:35.991955 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b36b06ac9bb460c8df0f9f175bcb801 with delete_type TABLET_DATA_DELETED (replaced by tablet cc10d812f78a47258ed9b6e5726e54fb) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:35.993227 10747 ts_tablet_manager.cc:1428] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:35.993503 10747 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:35.994856 10744 tablet_replica.cc:330] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:35.994843 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 040e836f705e4023905c863618b8248c (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:35.995141 10744 raft_consensus.cc:2229] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:35.995266 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 040e836f705e4023905c863618b8248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:35.995411 10744 raft_consensus.cc:2258] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:35.997154 10747 tablet_bootstrap.cc:654] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.997206 10745 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:35.998936 10745 tablet_bootstrap.cc:654] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:35.997371 10744 ts_tablet_manager.cc:1905] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.001235 10395 tablet_service.cc:1514] Processing DeleteTablet for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e with delete_type TABLET_DATA_DELETED (replaced by tablet ed3266630f274ef58f1a95fbd5aaf559) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:36.004199 10743 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.004340 10743 ts_tablet_manager.cc:1397] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.005s
I20260925 04:54:36.005055 10743 raft_consensus.cc:348] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.005720 10743 raft_consensus.cc:374] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.005815 10743 raft_consensus.cc:729] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.007861 10743 consensus_queue.cc:260] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.009205 10747 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.009342 10747 ts_tablet_manager.cc:1397] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260925 04:54:36.010032 10747 raft_consensus.cc:348] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.010259 10747 raft_consensus.cc:374] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.010356 10747 raft_consensus.cc:729] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.010553 10747 consensus_queue.cc:260] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.011919 10747 ts_tablet_manager.cc:1428] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:36.012213 10747 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.015304 10743 ts_tablet_manager.cc:1428] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260925 04:54:36.015375 10124 tablet_service.cc:1467] Processing CreateTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.015753 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 040e836f705e4023905c863618b8248c (DEFAULT_TABLE table=default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.016022 10744 ts_tablet_manager.cc:1918] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.016196 10744 log.cc:1196] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/0b36b06ac9bb460c8df0f9f175bcb801
I20260925 04:54:36.016548 10744 ts_tablet_manager.cc:1939] T 0b36b06ac9bb460c8df0f9f175bcb801 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:36.016608 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3266630f274ef58f1a95fbd5aaf559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.017078 10746 tablet_replica.cc:330] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:36.017268 10746 raft_consensus.cc:2229] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.017465 10746 raft_consensus.cc:2258] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.017854 10743 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.018224 10746 ts_tablet_manager.cc:1905] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.018888 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 040e836f705e4023905c863618b8248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.020186 10849 raft_consensus.cc:482] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.020332 10849 raft_consensus.cc:504] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.020890 10849 leader_election.cc:288] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.021303 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc10d812f78a47258ed9b6e5726e54fb" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:36.021303 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc10d812f78a47258ed9b6e5726e54fb" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:36.021461 10747 tablet_bootstrap.cc:654] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.021559 10282 raft_consensus.cc:2454] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:36.022496 10077 leader_election.cc:302] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.022775 10849 raft_consensus.cc:2781] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.022753 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet 0b36b06ac9bb460c8df0f9f175bcb801 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:36.022876 10849 raft_consensus.cc:482] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.022980 10849 raft_consensus.cc:3037] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
W20260925 04:54:36.023032 10579 catalog_manager.cc:4821] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): delete failed for tablet e7ceefe8a6894cc78cf3d7d5f3433c8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7ceefe8a6894cc78cf3d7d5f3433c8e already in progress: creating tablet
I20260925 04:54:36.023831 10743 tablet_bootstrap.cc:654] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:36.023789 10078 leader_election.cc:341] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:36.025663 10849 raft_consensus.cc:504] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.026332 10849 leader_election.cc:288] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.026669 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc10d812f78a47258ed9b6e5726e54fb" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:36.026798 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc10d812f78a47258ed9b6e5726e54fb" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:36.026991 10282 raft_consensus.cc:3037] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
W20260925 04:54:36.029302 10078 leader_election.cc:341] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:36.029932 10395 tablet_service.cc:1467] Processing CreateTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.030455 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3266630f274ef58f1a95fbd5aaf559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.031723 10282 raft_consensus.cc:2454] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:36.032954 10261 tablet_service.cc:1467] Processing CreateTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 (DEFAULT_TABLE table=default.table_c4023953be09425f877d1e8a30f45361 [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.034133 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3266630f274ef58f1a95fbd5aaf559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.042407 10077 leader_election.cc:302] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 604491977af14bc2b62f45a594c13bf9
I20260925 04:54:36.042707 10849 raft_consensus.cc:2781] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.047434 10588 catalog_manager.cc:2148] created HMS catalog entry for table [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:36.053471 10645 catalog_manager.cc:2709] Deleting table default.table_273e0dfb03e648e4b9fd3a8abf07a709 [id=27c0608f6eee489492ab4e3bb85230ba] in response to Hive Metastore notification log event 14
W20260925 04:54:36.053872 10645 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 14 DROP_TABLE default.table_273e0dfb03e648e4b9fd3a8abf07a709: Not found: the table does not exist: table_id: "27c0608f6eee489492ab4e3bb85230ba" table_name: "default.table_273e0dfb03e648e4b9fd3a8abf07a709"
I20260925 04:54:36.053908 10588 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52548 (request call id 6) took 3086 ms. Trace:
I20260925 04:54:36.054080 10588 rpcz_store.cc:276] 0925 04:54:32.967718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:32.971181 (+ 3463us) service_pool.cc:227] Handling call
0925 04:54:34.972661 (+2001480us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:34.974566 (+ 1905us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:36.047371 (+1072805us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:36.053604 (+ 6233us) catalog_manager.cc:2181] Wrote table and tablets to system table
0925 04:54:36.053746 (+ 142us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0925 04:54:36.053852 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:36.048091 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 04:54:36.048200 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0925 04:54:36.048207 (+ 7us) write_op.cc:435] Acquired schema lock
0925 04:54:36.048211 (+ 4us) tablet.cc:660] Decoding operations
0925 04:54:36.048307 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0925 04:54:36.048322 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0925 04:54:36.048327 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0925 04:54:36.048409 (+ 82us) tablet.cc:699] Row locks acquired
0925 04:54:36.048411 (+ 2us) write_op.cc:260] PREPARE: finished
0925 04:54:36.048445 (+ 34us) write_op.cc:270] Start()
0925 04:54:36.048480 (+ 35us) write_op.cc:276] Timestamp: P: 1790312076048406 usec, L: 0
0925 04:54:36.048484 (+ 4us) op_driver.cc:331] REPLICATION: starting
0925 04:54:36.048660 (+ 176us) log.cc:842] Serialized 433 byte log entry
0925 04:54:36.052235 (+ 3575us) op_driver.cc:444] REPLICATION: finished
0925 04:54:36.052385 (+ 150us) write_op.cc:301] APPLY: starting
0925 04:54:36.052399 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0925 04:54:36.052440 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0925 04:54:36.052459 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 04:54:36.052573 (+ 114us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 04:54:36.052609 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 04:54:36.052615 (+ 6us) write_op.cc:312] APPLY: finished
0925 04:54:36.052690 (+ 75us) log.cc:842] Serialized 29 byte log entry
0925 04:54:36.052760 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.052778 (+ 18us) write_op.cc:454] Released schema lock
0925 04:54:36.052784 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0925 04:54:36.052837 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.052843 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":915971,"Hive Metastore.run_cpu_time_us":289,"Hive Metastore.run_wall_time_us":156672,"child_traces":[["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":506,"apply.run_wall_time_us":505,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":762,"prepare.run_wall_time_us":762,"raft.queue_time_us":1254,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":252,"replication_time_us":3731}]]}
I20260925 04:54:36.056798 10588 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:36.057732 10745 tablet_bootstrap.cc:492] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.057888 10745 ts_tablet_manager.cc:1397] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.001s
I20260925 04:54:36.059208 10745 raft_consensus.cc:348] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.059427 10745 raft_consensus.cc:374] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.059547 10745 raft_consensus.cc:729] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.059789 10745 consensus_queue.cc:260] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.060340 10588 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52548:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:36.062000 10745 ts_tablet_manager.cc:1428] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260925 04:54:36.062361 10747 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.062532 10747 ts_tablet_manager.cc:1397] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.050s user 0.024s sys 0.001s
I20260925 04:54:36.063284 10747 raft_consensus.cc:348] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.063531 10747 raft_consensus.cc:374] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.063616 10747 raft_consensus.cc:729] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.063735 10745 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.063867 10747 consensus_queue.cc:260] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.067255 10745 tablet_bootstrap.cc:654] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.071439 10261 tablet_service.cc:1467] Processing CreateTablet for tablet e82ac233aa63482991098728b93ec1b6 (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.071444 10394 tablet_service.cc:1467] Processing CreateTablet for tablet e82ac233aa63482991098728b93ec1b6 (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.071843 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82ac233aa63482991098728b93ec1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.071838 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82ac233aa63482991098728b93ec1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.074237 10747 ts_tablet_manager.cc:1428] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.012s user 0.000s sys 0.004s
I20260925 04:54:36.074690 10747 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
W20260925 04:54:36.077190 10645 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed3266630f274ef58f1a95fbd5aaf559 consensus state has no leader
I20260925 04:54:36.078100 10849 raft_consensus.cc:686] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:36.078517 10645 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
I20260925 04:54:36.078361 10849 consensus_queue.cc:237] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
W20260925 04:54:36.078776 10645 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:36.078871 10645 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
I20260925 04:54:36.080247 10746 ts_tablet_manager.cc:1918] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.080353 10746 log.cc:1196] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:36.081305 10741 ts_tablet_manager.cc:1918] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.081452 10741 log.cc:1196] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e6e71bd63ef24c7aa8d7dc4788cd871f
I20260925 04:54:36.081812 10741 ts_tablet_manager.cc:1939] T e6e71bd63ef24c7aa8d7dc4788cd871f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
@ 0x7fdb4dbd89ad google::LogMessage::Fail() at ??:0
I20260925 04:54:36.082772 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet e6e71bd63ef24c7aa8d7dc4788cd871f (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:36.083725 10747 tablet_bootstrap.cc:654] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
@ 0x7fdb4dbdb88a google::LogMessage::SendToLog() at ??:0
I20260925 04:54:36.084623 10124 tablet_service.cc:1467] Processing CreateTablet for tablet e82ac233aa63482991098728b93ec1b6 (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.085059 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e82ac233aa63482991098728b93ec1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.085742 10741 tablet_replica.cc:330] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:36.086100 10741 raft_consensus.cc:2229] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.086258 10741 raft_consensus.cc:2258] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
@ 0x7fdb4dbd84de google::LogMessage::Flush() at ??:0
@ 0x7fdb4dbd86d1 google::LogMessage::~LogMessage() at ??:0
I20260925 04:54:36.090276 10746 ts_tablet_manager.cc:1939] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:36.091466 10741 ts_tablet_manager.cc:1905] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.094326 10580 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet e7ceefe8a6894cc78cf3d7d5f3433c8e (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]) successfully deleted
@ 0x7fdb63776ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260925 04:54:36.097888 10745 tablet_bootstrap.cc:492] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.098052 10745 ts_tablet_manager.cc:1397] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.005s
I20260925 04:54:36.098363 10593 master_service.cc:946] ReplaceTablet: received request to replace tablet cc10d812f78a47258ed9b6e5726e54fb from {username='slave'} at 127.0.0.1:52548
I20260925 04:54:36.100590 10745 raft_consensus.cc:348] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.100878 10745 raft_consensus.cc:374] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.100977 10745 raft_consensus.cc:729] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.101257 10745 consensus_queue.cc:260] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.101840 10745 ts_tablet_manager.cc:1428] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260925 04:54:36.102155 10745 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.103937 10745 tablet_bootstrap.cc:654] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.108034 10741 ts_tablet_manager.cc:1918] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.108201 10741 log.cc:1196] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/0565c53e13ca440facf15742afba3271
I20260925 04:54:36.108582 10741 ts_tablet_manager.cc:1939] T 0565c53e13ca440facf15742afba3271 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:36.116518 10745 tablet_bootstrap.cc:492] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.116671 10745 ts_tablet_manager.cc:1397] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
W20260925 04:54:36.117262 10580 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed3266630f274ef58f1a95fbd5aaf559 consensus state has no leader
I20260925 04:54:36.117419 10745 raft_consensus.cc:348] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.117827 10745 raft_consensus.cc:374] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.117924 10745 raft_consensus.cc:729] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.118150 10745 consensus_queue.cc:260] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.119059 10578 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet 0565c53e13ca440facf15742afba3271 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]) successfully deleted
I20260925 04:54:36.119820 10745 ts_tablet_manager.cc:1428] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:36.120103 10745 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
W20260925 04:54:36.120476 10578 catalog_manager.cc:4821] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): delete failed for tablet 590c902ec8ea41679146d82b058e01e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 590c902ec8ea41679146d82b058e01e3 already in progress: creating tablet
I20260925 04:54:36.121307 10741 tablet_replica.cc:330] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:36.122148 10741 raft_consensus.cc:2229] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.123399 10741 raft_consensus.cc:2258] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.123594 10593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet cc10d812f78a47258ed9b6e5726e54fb
I20260925 04:54:36.121873 10745 tablet_bootstrap.cc:654] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.124298 10593 catalog_manager.cc:6565] ReplaceTablet: tablet cc10d812f78a47258ed9b6e5726e54fb deleted and replaced by tablet c49c526a48d34b1d9560ca82c1ec794b
I20260925 04:54:36.124279 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet cc10d812f78a47258ed9b6e5726e54fb with delete_type TABLET_DATA_DELETED (replaced by tablet c49c526a48d34b1d9560ca82c1ec794b) from {username='slave'} at 127.0.0.1:46148
I20260925 04:54:36.124631 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet cc10d812f78a47258ed9b6e5726e54fb with delete_type TABLET_DATA_DELETED (replaced by tablet c49c526a48d34b1d9560ca82c1ec794b) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:36.124948 10746 tablet_replica.cc:330] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:36.126111 10396 tablet_service.cc:1514] Processing DeleteTablet for tablet 0565c53e13ca440facf15742afba3271 with delete_type TABLET_DATA_DELETED (replaced by tablet 84148597a8b74a0a957c5fc9fd716429) from {username='slave'} at 127.0.0.1:54288
I20260925 04:54:36.126235 10744 tablet_replica.cc:330] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:36.126394 10744 raft_consensus.cc:2229] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.126556 10744 raft_consensus.cc:2258] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.127305 10744 ts_tablet_manager.cc:1905] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fdb63775901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260925 04:54:36.132774 10119 tablet_service.cc:1467] Processing CreateTablet for tablet c49c526a48d34b1d9560ca82c1ec794b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.133241 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49c526a48d34b1d9560ca82c1ec794b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fdb6377c66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260925 04:54:36.136080 10417 raft_consensus.cc:1261] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Refusing update from remote peer d3c81f5b22cd4de9b25c02fd05b536b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 04:54:36.136646 9944 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=d4db82a7afd846539ba823bf792e493b]
I20260925 04:54:36.136981 9944 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 10) took 6782 ms. Trace:
I20260925 04:54:36.137123 9944 rpcz_store.cc:276] 0925 04:54:29.354218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.354272 (+ 54us) service_pool.cc:227] Handling call
0925 04:54:30.396187 (+1041915us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.396809 (+ 622us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:32.513059 (+2116250us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:32.513975 (+ 916us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.513978 (+ 3us) write_op.cc:454] Released schema lock
0925 04:54:32.514229 (+ 251us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:36.136941 (+3622712us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:32.513905 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:32.513916 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.513923 (+ 7us) write_op.cc:454] Released schema lock
0925 04:54:32.513927 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":5310269,"Hive Metastore.run_cpu_time_us":949,"Hive Metastore.run_wall_time_us":427389,"child_traces":[["op",{}]]}
I20260925 04:54:36.140578 10746 raft_consensus.cc:2229] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:36.141284 10746 pending_rounds.cc:62] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Trying to abort 1 pending ops.
I20260925 04:54:36.141366 10746 pending_rounds.cc:68] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333118263622828032 op_type: NO_OP noop_request { }
I20260925 04:54:36.141530 10746 raft_consensus.cc:2866] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 04:54:36.141644 10746 raft_consensus.cc:2258] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7fdb6377c4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260925 04:54:36.132534 10262 tablet_service.cc:1467] Processing CreateTablet for tablet c49c526a48d34b1d9560ca82c1ec794b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.136598 10552 consensus_queue.cc:1035] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260925 04:54:36.145522 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49c526a48d34b1d9560ca82c1ec794b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:36.145991 10744 ts_tablet_manager.cc:1918] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.146142 10744 log.cc:1196] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/cc10d812f78a47258ed9b6e5726e54fb
I20260925 04:54:36.146656 10744 ts_tablet_manager.cc:1939] T cc10d812f78a47258ed9b6e5726e54fb P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:36.146754 10144 raft_consensus.cc:1261] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Refusing update from remote peer d3c81f5b22cd4de9b25c02fd05b536b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 04:54:36.147280 10918 consensus_queue.cc:1035] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:36.147804 10579 catalog_manager.cc:4841] TS 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): tablet cc10d812f78a47258ed9b6e5726e54fb (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]) successfully deleted
I20260925 04:54:36.125348 10261 tablet_service.cc:1514] Processing DeleteTablet for tablet cc10d812f78a47258ed9b6e5726e54fb with delete_type TABLET_DATA_DELETED (replaced by tablet c49c526a48d34b1d9560ca82c1ec794b) from {username='slave'} at 127.0.0.1:49620
I20260925 04:54:36.157362 10744 tablet_replica.cc:330] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:36.157646 10744 raft_consensus.cc:2229] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.157846 10744 raft_consensus.cc:2258] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.158414 10394 tablet_service.cc:1467] Processing CreateTablet for tablet c49c526a48d34b1d9560ca82c1ec794b (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:36.158695 10744 ts_tablet_manager.cc:1905] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.158887 10394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49c526a48d34b1d9560ca82c1ec794b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fdb50802eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fdb53adc6db start_thread at ??:0
I20260925 04:54:36.167387 10743 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.167552 10743 ts_tablet_manager.cc:1397] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.014s
I20260925 04:54:36.167686 10746 ts_tablet_manager.cc:1905] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fdb4ca7261f clone at ??:0
I20260925 04:54:36.168329 10743 raft_consensus.cc:348] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.168545 10743 raft_consensus.cc:374] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.168606 10743 raft_consensus.cc:729] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.175019 10745 tablet_bootstrap.cc:492] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.175190 10745 ts_tablet_manager.cc:1397] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.010s
I20260925 04:54:36.175969 10745 raft_consensus.cc:348] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.176215 10745 raft_consensus.cc:374] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.176286 10745 raft_consensus.cc:729] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.176527 10745 consensus_queue.cc:260] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.177127 10745 ts_tablet_manager.cc:1428] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260925 04:54:36.177412 10745 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.179164 10745 tablet_bootstrap.cc:654] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.180390 10746 ts_tablet_manager.cc:1918] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:36.180536 10746 log.cc:1196] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/cc10d812f78a47258ed9b6e5726e54fb
I20260925 04:54:36.181936 10743 consensus_queue.cc:260] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.182524 10741 ts_tablet_manager.cc:1905] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.188082 10952 mvcc.cc:205] Tried to move back new op lower bound from 7333118263848038400 to 7333118262337748992. Current Snapshot: MvccSnapshot[applied={T|T < 7333118263848038400}]
I20260925 04:54:36.189221 10743 ts_tablet_manager.cc:1428] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260925 04:54:36.189672 10743 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.191222 10938 mvcc.cc:205] Tried to move back new op lower bound from 7333118263848038400 to 7333118262337748992. Current Snapshot: MvccSnapshot[applied={T|T < 7333118263848038400}]
I20260925 04:54:36.203342 10746 ts_tablet_manager.cc:1939] T cc10d812f78a47258ed9b6e5726e54fb P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:36.204471 10747 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.204614 10747 ts_tablet_manager.cc:1397] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.010s
I20260925 04:54:36.205518 10747 raft_consensus.cc:348] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.207108 10747 raft_consensus.cc:374] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.207213 10747 raft_consensus.cc:729] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.207458 10747 consensus_queue.cc:260] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.207955 10951 mvcc.cc:205] Tried to move back new op lower bound from 7333118263848038400 to 7333118262337748992. Current Snapshot: MvccSnapshot[applied={T|T < 7333118263848038400}]
I20260925 04:54:36.209476 10747 ts_tablet_manager.cc:1428] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:36.210090 10960 tablet.cc:1722] T 689a7134c47543feaf5c453171ecb75a P 604491977af14bc2b62f45a594c13bf9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 04:54:36.214596 10747 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.215916 10962 tablet.cc:1722] T 689a7134c47543feaf5c453171ecb75a P 270ea27d66a1425eae85f73563e04c00: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 04:54:36.216444 10747 tablet_bootstrap.cc:654] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.220688 10744 ts_tablet_manager.cc:1918] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.220844 10744 log.cc:1196] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/0565c53e13ca440facf15742afba3271
I20260925 04:54:36.225337 10744 ts_tablet_manager.cc:1939] T 0565c53e13ca440facf15742afba3271 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:36.229491 10743 tablet_bootstrap.cc:654] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.230569 10745 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.230711 10745 ts_tablet_manager.cc:1397] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.007s
I20260925 04:54:36.231462 10745 raft_consensus.cc:348] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.231681 10745 raft_consensus.cc:374] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.231775 10745 raft_consensus.cc:729] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.232021 10745 consensus_queue.cc:260] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.232615 10745 ts_tablet_manager.cc:1428] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:36.229362 10959 tablet.cc:1722] T 689a7134c47543feaf5c453171ecb75a P d3c81f5b22cd4de9b25c02fd05b536b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 04:54:36.245326 10747 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.245532 10747 ts_tablet_manager.cc:1397] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.004s
I20260925 04:54:36.246477 10747 raft_consensus.cc:348] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.246814 10747 raft_consensus.cc:374] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.246898 10747 raft_consensus.cc:729] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.247166 10747 consensus_queue.cc:260] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.251539 10745 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.252034 9945 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=0275d9aeebbb43e4b3fc0f1024d2856e]
I20260925 04:54:36.252343 9945 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 9) took 6902 ms. Trace:
I20260925 04:54:36.252476 9945 rpcz_store.cc:276] 0925 04:54:29.350248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.350333 (+ 85us) service_pool.cc:227] Handling call
0925 04:54:30.397487 (+1047154us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.398070 (+ 583us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:32.725101 (+2327031us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:32.725903 (+ 802us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.725907 (+ 4us) write_op.cc:454] Released schema lock
0925 04:54:32.726122 (+ 215us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:36.252303 (+3526181us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:32.725832 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:32.725843 (+ 11us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.725849 (+ 6us) write_op.cc:454] Released schema lock
0925 04:54:32.725854 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":5525088,"Hive Metastore.run_cpu_time_us":532,"Hive Metastore.run_wall_time_us":327337,"child_traces":[["op",{}]]}
I20260925 04:54:36.253448 10745 tablet_bootstrap.cc:654] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.254184 10970 raft_consensus.cc:482] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.254443 10970 raft_consensus.cc:504] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.255987 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c902ec8ea41679146d82b058e01e3" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:36.256274 10144 raft_consensus.cc:2454] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.257369 10353 leader_election.cc:302] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:36.257645 10803 raft_consensus.cc:2781] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.257740 10803 raft_consensus.cc:482] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.257809 10803 raft_consensus.cc:3037] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.260545 10803 raft_consensus.cc:504] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.261500 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c902ec8ea41679146d82b058e01e3" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:36.261734 10144 raft_consensus.cc:3037] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.264279 10144 raft_consensus.cc:2454] T 590c902ec8ea41679146d82b058e01e3 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:36.264735 10353 leader_election.cc:302] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:36.265367 10803 leader_election.cc:288] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.265537 10803 raft_consensus.cc:2781] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.265650 10803 raft_consensus.cc:686] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:36.265889 10803 consensus_queue.cc:237] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.273765 10747 ts_tablet_manager.cc:1428] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.028s user 0.000s sys 0.003s
I20260925 04:54:36.274546 10970 leader_election.cc:288] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.275889 10747 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.282609 10747 tablet_bootstrap.cc:654] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.286698 10745 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.286863 10745 ts_tablet_manager.cc:1397] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.003s
I20260925 04:54:36.287544 10745 raft_consensus.cc:348] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.287765 10745 raft_consensus.cc:374] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.287822 10745 raft_consensus.cc:729] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.288053 10745 consensus_queue.cc:260] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.288516 10745 ts_tablet_manager.cc:1428] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:36.288801 10745 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.296175 10741 ts_tablet_manager.cc:1918] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.296305 10741 log.cc:1196] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/b85a274b180645fc9ad9678b86bfb706
I20260925 04:54:36.296769 10741 ts_tablet_manager.cc:1939] T b85a274b180645fc9ad9678b86bfb706 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:36.295866 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c902ec8ea41679146d82b058e01e3" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
W20260925 04:54:36.297936 10351 leader_election.cc:341] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:36.298244 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c902ec8ea41679146d82b058e01e3" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
W20260925 04:54:36.298677 10351 leader_election.cc:341] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:36.302893 10745 tablet_bootstrap.cc:654] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.309587 10741 tablet_replica.cc:330] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:36.309803 10741 raft_consensus.cc:2229] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.309970 10741 raft_consensus.cc:2258] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.310994 10743 tablet_bootstrap.cc:492] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.311143 10743 ts_tablet_manager.cc:1397] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.122s user 0.002s sys 0.005s
I20260925 04:54:36.311865 10743 raft_consensus.cc:348] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.312083 10743 raft_consensus.cc:374] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.312171 10743 raft_consensus.cc:729] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.312398 10743 consensus_queue.cc:260] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.315824 10743 ts_tablet_manager.cc:1428] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 04:54:36.318630 10743 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.320963 10743 tablet_bootstrap.cc:654] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.322883 10741 ts_tablet_manager.cc:1905] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.353813 10745 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.354017 10745 ts_tablet_manager.cc:1397] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.065s user 0.016s sys 0.003s
I20260925 04:54:36.355082 10745 raft_consensus.cc:348] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.355362 10745 raft_consensus.cc:374] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.355480 10745 raft_consensus.cc:729] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.355792 10745 consensus_queue.cc:260] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.356410 10745 ts_tablet_manager.cc:1428] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:36.357719 10743 tablet_bootstrap.cc:492] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.357916 10743 ts_tablet_manager.cc:1397] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260925 04:54:36.358789 10743 raft_consensus.cc:348] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.359078 10743 raft_consensus.cc:374] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.359160 10743 raft_consensus.cc:729] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.361997 10747 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.362175 10747 ts_tablet_manager.cc:1397] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.086s user 0.000s sys 0.003s
I20260925 04:54:36.363142 10747 raft_consensus.cc:348] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.363416 10747 raft_consensus.cc:374] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.363543 10747 raft_consensus.cc:729] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.363847 10747 consensus_queue.cc:260] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.364674 10747 ts_tablet_manager.cc:1428] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260925 04:54:36.365036 10747 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.366647 10747 tablet_bootstrap.cc:654] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.381492 10743 consensus_queue.cc:260] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.381892 10966 raft_consensus.cc:482] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.382026 9946 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=275ebdadce0a4c988813c6a91371ab32]
I20260925 04:54:36.382077 10966 raft_consensus.cc:504] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.382387 9946 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 8) took 7037 ms. Trace:
I20260925 04:54:36.382519 9946 rpcz_store.cc:276] 0925 04:54:29.345421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:29.345504 (+ 83us) service_pool.cc:227] Handling call
0925 04:54:30.394768 (+1049264us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:30.398598 (+ 3830us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:32.918711 (+2520113us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:32.919717 (+ 1006us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.919720 (+ 3us) write_op.cc:454] Released schema lock
0925 04:54:32.919939 (+ 219us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:36.382347 (+3462408us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:32.919641 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:32.919654 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:32.919661 (+ 7us) write_op.cc:454] Released schema lock
0925 04:54:32.919666 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":5658179,"Hive Metastore.run_cpu_time_us":508,"Hive Metastore.run_wall_time_us":323409,"child_traces":[["op",{}]]}
I20260925 04:54:36.383261 10966 leader_election.cc:288] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:36.384443 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec88d2656214489b9b14f8517b549ad" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:36.384694 10144 raft_consensus.cc:2454] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:36.385172 10218 leader_election.cc:302] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.386160 10966 raft_consensus.cc:2781] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.386293 10966 raft_consensus.cc:482] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.386394 10966 raft_consensus.cc:3037] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.390264 10966 raft_consensus.cc:504] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.391515 10966 leader_election.cc:288] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:36.391872 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec88d2656214489b9b14f8517b549ad" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:36.392063 10144 raft_consensus.cc:3037] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.393715 10741 ts_tablet_manager.cc:1918] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.394302 10741 log.cc:1196] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:36.394659 10741 ts_tablet_manager.cc:1939] T e7ceefe8a6894cc78cf3d7d5f3433c8e P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:36.395319 10144 raft_consensus.cc:2454] T 4ec88d2656214489b9b14f8517b549ad P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:36.395687 10218 leader_election.cc:302] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.396044 10966 raft_consensus.cc:2781] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.397008 10966 raft_consensus.cc:686] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:36.397370 10966 consensus_queue.cc:237] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.398904 10743 ts_tablet_manager.cc:1428] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.041s user 0.002s sys 0.001s
I20260925 04:54:36.399223 10743 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.402040 10552 raft_consensus.cc:482] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.402004 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec88d2656214489b9b14f8517b549ad" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:36.402249 10417 raft_consensus.cc:2454] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:36.402174 10552 raft_consensus.cc:504] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.402545 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec88d2656214489b9b14f8517b549ad" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:36.402693 10552 leader_election.cc:288] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:36.402767 10416 raft_consensus.cc:3037] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.403273 10745 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.404964 10745 tablet_bootstrap.cc:654] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.406296 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84148597a8b74a0a957c5fc9fd716429" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:36.406513 10144 raft_consensus.cc:2454] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:36.406823 10218 leader_election.cc:302] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.407083 10552 raft_consensus.cc:2781] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.407019 10417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84148597a8b74a0a957c5fc9fd716429" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:36.407156 10552 raft_consensus.cc:482] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.407214 10417 raft_consensus.cc:2454] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:36.407254 10552 raft_consensus.cc:3037] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.409355 10416 raft_consensus.cc:2454] T 4ec88d2656214489b9b14f8517b549ad P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:36.409677 10552 raft_consensus.cc:504] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.410521 10552 leader_election.cc:288] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:36.411291 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84148597a8b74a0a957c5fc9fd716429" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:36.411489 10144 raft_consensus.cc:3037] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.414429 10144 raft_consensus.cc:2454] T 84148597a8b74a0a957c5fc9fd716429 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:36.414799 10218 leader_election.cc:302] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.414873 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84148597a8b74a0a957c5fc9fd716429" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:36.415046 10416 raft_consensus.cc:3037] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.415058 10552 raft_consensus.cc:2781] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.416733 10747 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.515969 10747 ts_tablet_manager.cc:1397] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.151s user 0.003s sys 0.000s
I20260925 04:54:36.418812 10416 raft_consensus.cc:2454] T 84148597a8b74a0a957c5fc9fd716429 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:36.516870 10747 raft_consensus.cc:348] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.517154 10747 raft_consensus.cc:374] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.517237 10747 raft_consensus.cc:729] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.517481 10747 consensus_queue.cc:260] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.518051 10747 ts_tablet_manager.cc:1428] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:36.518375 10747 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.519928 10747 tablet_bootstrap.cc:654] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.433117 10745 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.520576 10745 ts_tablet_manager.cc:1397] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.000s
I20260925 04:54:36.521420 10745 raft_consensus.cc:348] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.521679 10745 raft_consensus.cc:374] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.524974 10747 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.558602 10747 ts_tablet_manager.cc:1397] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.001s
I20260925 04:54:36.559474 10747 raft_consensus.cc:348] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.559752 10747 raft_consensus.cc:374] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.559839 10747 raft_consensus.cc:729] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.560061 10747 consensus_queue.cc:260] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.560634 10747 ts_tablet_manager.cc:1428] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:36.560961 10747 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.415311 10552 raft_consensus.cc:686] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:36.561298 10552 consensus_queue.cc:237] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.521778 10745 raft_consensus.cc:729] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.562585 10745 consensus_queue.cc:260] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.563153 10745 ts_tablet_manager.cc:1428] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260925 04:54:36.563494 10745 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.565478 10745 tablet_bootstrap.cc:654] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.419502 10743 tablet_bootstrap.cc:654] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.422197 10741 tablet_replica.cc:330] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:36.566044 10741 raft_consensus.cc:2229] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:36.566255 10741 raft_consensus.cc:2258] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:36.566823 10741 ts_tablet_manager.cc:1905] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:36.570526 10747 tablet_bootstrap.cc:654] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.572124 10743 tablet_bootstrap.cc:492] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.572276 10743 ts_tablet_manager.cc:1397] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.173s user 0.003s sys 0.001s
I20260925 04:54:36.573227 10743 raft_consensus.cc:348] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.573544 10743 raft_consensus.cc:374] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.573630 10743 raft_consensus.cc:729] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.573851 10743 consensus_queue.cc:260] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.574930 10743 ts_tablet_manager.cc:1428] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:36.575454 10743 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.577386 10743 tablet_bootstrap.cc:654] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.579394 10741 ts_tablet_manager.cc:1918] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 04:54:36.579530 10741 log.cc:1196] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/cc10d812f78a47258ed9b6e5726e54fb
I20260925 04:54:36.579945 10741 ts_tablet_manager.cc:1939] T cc10d812f78a47258ed9b6e5726e54fb P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:36.584208 10743 tablet_bootstrap.cc:492] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.584375 10743 ts_tablet_manager.cc:1397] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260925 04:54:36.585116 10743 raft_consensus.cc:348] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.585351 10743 raft_consensus.cc:374] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.585436 10743 raft_consensus.cc:729] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.586164 10747 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.586331 10747 ts_tablet_manager.cc:1397] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260925 04:54:36.587023 10747 raft_consensus.cc:348] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.587271 10747 raft_consensus.cc:374] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.587352 10747 raft_consensus.cc:729] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.587603 10747 consensus_queue.cc:260] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.590001 10747 ts_tablet_manager.cc:1428] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 04:54:36.591987 10747 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:36.594018 10747 tablet_bootstrap.cc:654] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.595003 10743 consensus_queue.cc:260] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.597023 10743 ts_tablet_manager.cc:1428] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260925 04:54:36.598752 10743 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.601545 10743 tablet_bootstrap.cc:654] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.603605 10747 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:36.603776 10747 ts_tablet_manager.cc:1397] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260925 04:54:36.604750 10747 raft_consensus.cc:348] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.604965 10747 raft_consensus.cc:374] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.605115 10747 raft_consensus.cc:729] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.605362 10747 consensus_queue.cc:260] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.608076 10747 ts_tablet_manager.cc:1428] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260925 04:54:36.610873 10217 connection.cc:535] server connection from 127.0.0.1:49620 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:36.610932 10350 connection.cc:535] server connection from 127.0.0.1:54288 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 04:54:36.612574 10745 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.612744 10745 ts_tablet_manager.cc:1397] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.000s
I20260925 04:54:36.612888 10743 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.613130 10743 ts_tablet_manager.cc:1397] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260925 04:54:36.613555 10745 raft_consensus.cc:348] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.613838 10745 raft_consensus.cc:374] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.613945 10745 raft_consensus.cc:729] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.614198 10745 consensus_queue.cc:260] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.614558 10743 raft_consensus.cc:348] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.614806 10745 ts_tablet_manager.cc:1428] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:36.614823 10743 raft_consensus.cc:374] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.615003 10743 raft_consensus.cc:729] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.615296 10743 consensus_queue.cc:260] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.617071 10743 ts_tablet_manager.cc:1428] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 04:54:36.617832 10743 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.618254 10745 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
W20260925 04:54:36.619625 10076 connection.cc:535] server connection from 127.0.0.1:46148 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:36.620940 10471 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:36.621517 10471 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.189:45475)
I20260925 04:54:36.621737 10745 tablet_bootstrap.cc:654] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:36.621927 10471 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:36.622632 10471 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:36.623104 10471 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.189:45475)
I20260925 04:54:36.625872 10743 tablet_bootstrap.cc:654] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
W20260925 04:54:36.626871 10217 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:36.627338 10756 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:36.622514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.131:56505)
0925 04:54:36.622750 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:36.622780 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:36.622910 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:36.627068 (+ 4158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":115}
I20260925 04:54:36.627833 10745 tablet_bootstrap.cc:492] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.627990 10745 ts_tablet_manager.cc:1397] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
W20260925 04:54:36.628021 10757 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:36.621212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.129:47003)
0925 04:54:36.624919 (+ 3707us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:36.624944 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:36.625531 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:36.627793 (+ 2262us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":3544}
I20260925 04:54:36.628965 10745 raft_consensus.cc:348] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.629236 10745 raft_consensus.cc:374] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.629311 10745 raft_consensus.cc:729] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.629575 10745 consensus_queue.cc:260] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
W20260925 04:54:36.630892 10909 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:36.626544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.0.0.1:52564)
0925 04:54:36.626708 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:36.626731 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:36.626854 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:36.628977 (+ 2123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":52,"thread_start_us":1932,"threads_started":1}
I20260925 04:54:36.631628 10743 tablet_bootstrap.cc:492] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.631800 10743 ts_tablet_manager.cc:1397] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260925 04:54:36.632540 10745 ts_tablet_manager.cc:1428] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 04:54:36.632540 10743 raft_consensus.cc:348] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.632792 10743 raft_consensus.cc:374] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.632872 10743 raft_consensus.cc:729] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.633134 10743 consensus_queue.cc:260] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.634871 10745 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:36.638460 10745 tablet_bootstrap.cc:654] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.641808 10743 ts_tablet_manager.cc:1428] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 04:54:36.652328 10743 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:36.654245 10743 tablet_bootstrap.cc:654] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:36.660607 10743 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:36.660760 10743 ts_tablet_manager.cc:1397] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260925 04:54:36.662165 10743 raft_consensus.cc:348] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.662874 10743 raft_consensus.cc:374] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.663007 10743 raft_consensus.cc:729] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.663291 10743 consensus_queue.cc:260] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.664860 10745 tablet_bootstrap.cc:492] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:36.665033 10745 ts_tablet_manager.cc:1397] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.006s
I20260925 04:54:36.666033 10743 ts_tablet_manager.cc:1428] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 04:54:36.666625 10745 raft_consensus.cc:348] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.666846 10745 raft_consensus.cc:374] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:36.666946 10745 raft_consensus.cc:729] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.667178 10745 consensus_queue.cc:260] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.670002 10745 ts_tablet_manager.cc:1428] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 04:54:36.670285 9952 catalog_manager.cc:3411] renamed table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c] in HMS: new name default.table_046291a687f44532af93aec0cf2df2c4
I20260925 04:54:36.671661 9952 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60174 (request call id 17) took 6120 ms. Trace:
I20260925 04:54:36.671772 9952 rpcz_store.cc:276] 0925 04:54:30.550704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:30.633210 (+ 82506us) service_pool.cc:227] Handling call
0925 04:54:32.925438 (+2292228us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:36.670843 (+3745405us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:36.671251 (+ 408us) catalog_manager.cc:3616] Apply alter schema
0925 04:54:36.671621 (+ 370us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3456070,"Hive Metastore.run_cpu_time_us":1300,"Hive Metastore.run_wall_time_us":288419}
I20260925 04:54:36.672614 11024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:36.675182 11024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:36.675917 11024 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:36.679797 9939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:54:36.682528 9939 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:36.682723 9939 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:36.682816 9939 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:36.683224 11024 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 04:54:36.687844 10803 raft_consensus.cc:482] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.688087 10803 raft_consensus.cc:504] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.688905 10803 leader_election.cc:288] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.689416 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3266630f274ef58f1a95fbd5aaf559" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:36.689688 10144 raft_consensus.cc:2454] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.690074 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3266630f274ef58f1a95fbd5aaf559" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:36.690363 10281 raft_consensus.cc:2454] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.690876 10353 leader_election.cc:302] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:36.691208 10803 raft_consensus.cc:2781] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.691360 10803 raft_consensus.cc:482] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.691498 10803 raft_consensus.cc:3037] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.695164 10803 raft_consensus.cc:504] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.697266 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3266630f274ef58f1a95fbd5aaf559" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:36.697547 10144 raft_consensus.cc:3037] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.703238 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3266630f274ef58f1a95fbd5aaf559" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:36.703466 10281 raft_consensus.cc:3037] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.703635 10144 raft_consensus.cc:2454] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:36.704288 10353 leader_election.cc:302] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:36.704634 10970 raft_consensus.cc:2781] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.704797 10970 raft_consensus.cc:686] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:36.705940 10970 consensus_queue.cc:237] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.706175 10281 raft_consensus.cc:2454] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:36.707842 10803 leader_election.cc:288] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.728277 10796 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.190:37617
I20260925 04:54:36.728861 10970 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.729090 10970 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.729820 10970 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.728283 11045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.190:37617 every 8 connection(s)
I20260925 04:54:36.731986 10796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
W20260925 04:54:36.733577 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:36.734201 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:36.734356 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:36.734817 10970 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:36.738197 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 10796
I20260925 04:54:36.751540 9947 catalog_manager.cc:2148] created HMS catalog entry for table [id=ad2500ffdcd94bc9a60d14729304e1d8]
W20260925 04:54:36.752434 9947 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:36.789158 9950 catalog_manager.cc:2148] created HMS catalog entry for table [id=90a3687ad1d54731975c16d87433564c]
W20260925 04:54:36.790055 9950 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER
I20260925 04:54:36.796751 11046 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:36.802193 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap starting.
I20260925 04:54:36.821466 11046 log.cc:824] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:36.853731 9949 catalog_manager.cc:3411] renamed table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f] in HMS: new name default.table_421a98a632c24f8296c302eef981e44f
I20260925 04:54:36.854962 9949 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60174 (request call id 25) took 5991 ms. Trace:
I20260925 04:54:36.855082 9949 rpcz_store.cc:276] 0925 04:54:30.863552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:31.453875 (+590323us) service_pool.cc:227] Handling call
0925 04:54:32.931352 (+1477477us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:36.854317 (+3922965us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0925 04:54:36.854609 (+ 292us) catalog_manager.cc:3616] Apply alter schema
0925 04:54:36.854898 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3857312,"Hive Metastore.run_cpu_time_us":728,"Hive Metastore.run_wall_time_us":64809}
I20260925 04:54:36.867856 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=28 overwritten=0 applied=27 ignored=0} inserts{seen=17 ignored=0} mutations{seen=18 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260925 04:54:36.868683 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap complete.
I20260925 04:54:36.883443 11046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:36.888739 11046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37499e1d150b41169507d4dd098579b5, State: Initialized, Role: FOLLOWER
I20260925 04:54:36.889122 9947 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=ad2500ffdcd94bc9a60d14729304e1d8]
I20260925 04:54:36.889446 9947 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 18) took 6301 ms. Trace:
I20260925 04:54:36.889562 9947 rpcz_store.cc:276] 0925 04:54:30.588218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:30.932944 (+344726us) service_pool.cc:227] Handling call
0925 04:54:32.929512 (+1996568us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:32.930091 (+ 579us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:36.751476 (+3821385us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:36.752313 (+ 837us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.752317 (+ 4us) write_op.cc:454] Released schema lock
0925 04:54:36.752564 (+ 247us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:36.889398 (+136834us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:36.752238 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:36.752251 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.752257 (+ 6us) write_op.cc:454] Released schema lock
0925 04:54:36.752262 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":3841112,"Hive Metastore.run_cpu_time_us":621,"Hive Metastore.run_wall_time_us":116435,"child_traces":[["op",{}]]}
I20260925 04:54:36.889783 11046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 2.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:36.891623 11052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:36.892045 11052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:36.893388 11046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:36.941403 9950 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=90a3687ad1d54731975c16d87433564c]
I20260925 04:54:36.941804 9950 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60174 (request call id 19) took 6188 ms. Trace:
I20260925 04:54:36.941918 9950 rpcz_store.cc:276] 0925 04:54:30.753099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 04:54:31.178176 (+425077us) service_pool.cc:227] Handling call
0925 04:54:32.930653 (+1752477us) catalog_manager.cc:2075] Acquired catalog manager lock
0925 04:54:32.931155 (+ 502us) catalog_manager.cc:2121] Created new table and tablet info
0925 04:54:36.789125 (+3857970us) catalog_manager.cc:2147] Created new table in HMS catalog
0925 04:54:36.789922 (+ 797us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.789925 (+ 3us) write_op.cc:454] Released schema lock
0925 04:54:36.790165 (+ 240us) catalog_manager.cc:2155] Rolling back HMS table creation
0925 04:54:36.941733 (+151568us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 04:54:36.789850 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica 39da3a5fade344af9db436d10052b4bc is not leader of this config: current role FOLLOWER)
0925 04:54:36.789863 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0925 04:54:36.789869 (+ 6us) write_op.cc:454] Released schema lock
0925 04:54:36.789874 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":3918974,"Hive Metastore.run_cpu_time_us":576,"Hive Metastore.run_wall_time_us":89575,"child_traces":[["op",{}]]}
I20260925 04:54:36.951249 11066 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:36.951376 11066 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: loading cluster ID for follower catalog manager: success
I20260925 04:54:36.955482 11066 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: acquiring CA information for follower catalog manager: success
I20260925 04:54:36.958184 11066 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:36.980700 10970 raft_consensus.cc:482] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.980880 10970 raft_consensus.cc:504] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.981709 10970 leader_election.cc:288] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.973199 10796 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:54:36.982366 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "040e836f705e4023905c863618b8248c" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:36.982478 10796 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:36.982615 10281 raft_consensus.cc:2454] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.982957 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "040e836f705e4023905c863618b8248c" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:36.983139 10351 leader_election.cc:302] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.983209 10144 raft_consensus.cc:2454] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.983394 10970 raft_consensus.cc:2781] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.983491 10970 raft_consensus.cc:482] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.983575 10970 raft_consensus.cc:3037] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.986325 10970 raft_consensus.cc:504] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.987321 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "040e836f705e4023905c863618b8248c" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:36.987386 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "040e836f705e4023905c863618b8248c" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:36.987520 10144 raft_consensus.cc:3037] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.987560 10281 raft_consensus.cc:3037] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:36.990229 10144 raft_consensus.cc:2454] T 040e836f705e4023905c863618b8248c P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:36.990271 10281 raft_consensus.cc:2454] T 040e836f705e4023905c863618b8248c P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:36.990731 10351 leader_election.cc:302] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.991004 10803 raft_consensus.cc:2781] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:36.991011 10970 leader_election.cc:288] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.991185 10803 raft_consensus.cc:686] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:36.991442 10803 consensus_queue.cc:237] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.996068 10973 raft_consensus.cc:482] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:36.996206 10973 raft_consensus.cc:504] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:36.996735 10973 leader_election.cc:288] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:36.997949 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ec2296f1d414013bb2699ed9fd7d2fc" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:36.998215 10281 raft_consensus.cc:2454] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:36.998662 10351 leader_election.cc:302] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:36.998989 10973 raft_consensus.cc:2781] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:36.999092 10973 raft_consensus.cc:482] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:36.999192 10973 raft_consensus.cc:3037] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.002046 10973 raft_consensus.cc:504] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.003293 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ec2296f1d414013bb2699ed9fd7d2fc" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:37.003549 10143 raft_consensus.cc:3037] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.005483 10143 raft_consensus.cc:2454] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:37.005924 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ec2296f1d414013bb2699ed9fd7d2fc" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:37.005985 10353 leader_election.cc:302] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:37.006249 10803 raft_consensus.cc:2781] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:37.006271 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ec2296f1d414013bb2699ed9fd7d2fc" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:37.006403 10803 raft_consensus.cc:686] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:37.006501 10144 raft_consensus.cc:2362] T 7ec2296f1d414013bb2699ed9fd7d2fc P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1. Re-sending same reply.
I20260925 04:54:37.006656 10803 consensus_queue.cc:237] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.007655 10281 raft_consensus.cc:3037] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.009521 10281 raft_consensus.cc:2454] T 7ec2296f1d414013bb2699ed9fd7d2fc P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:37.009778 10973 leader_election.cc:288] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:37.017683 10463 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:37.022398 10977 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:54079; Asking this server to re-register.
I20260925 04:54:37.023437 10463 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:37.025532 10977 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:37.038003 10552 raft_consensus.cc:482] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:37.038182 10552 raft_consensus.cc:504] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.038851 10552 leader_election.cc:288] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:37.039325 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82ac233aa63482991098728b93ec1b6" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:37.039458 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82ac233aa63482991098728b93ec1b6" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:37.039590 10416 raft_consensus.cc:2454] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:37.039707 10144 raft_consensus.cc:2454] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:37.040129 10217 leader_election.cc:302] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:37.040403 10552 raft_consensus.cc:2781] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:37.040539 10552 raft_consensus.cc:482] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:37.040650 10552 raft_consensus.cc:3037] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.042563 10552 raft_consensus.cc:504] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.043110 10552 leader_election.cc:288] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:37.043526 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82ac233aa63482991098728b93ec1b6" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:37.043558 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e82ac233aa63482991098728b93ec1b6" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:37.043728 10416 raft_consensus.cc:3037] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.043736 10144 raft_consensus.cc:3037] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.045642 10144 raft_consensus.cc:2454] T e82ac233aa63482991098728b93ec1b6 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:37.046041 10218 leader_election.cc:302] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:37.046283 10552 raft_consensus.cc:2781] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:37.046550 10416 raft_consensus.cc:2454] T e82ac233aa63482991098728b93ec1b6 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:37.046733 10552 raft_consensus.cc:686] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:37.047446 10552 consensus_queue.cc:237] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.055814 10328 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:37.058043 10978 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:57985; Asking this server to re-register.
I20260925 04:54:37.058831 10328 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:37.060228 10978 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:37.108392 10281 raft_consensus.cc:3037] T 590c902ec8ea41679146d82b058e01e3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.112169 10803 consensus_queue.cc:1035] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.123008 10190 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:37.123137 10973 consensus_queue.cc:1035] T 590c902ec8ea41679146d82b058e01e3 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.125560 10978 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:54029; Asking this server to re-register.
I20260925 04:54:37.126480 10190 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:37.128033 10978 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:37.235579 10973 raft_consensus.cc:482] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:37.235790 10973 raft_consensus.cc:504] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.236421 10973 leader_election.cc:288] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:37.237023 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49c526a48d34b1d9560ca82c1ec794b" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:37.237066 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49c526a48d34b1d9560ca82c1ec794b" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:37.237303 10144 raft_consensus.cc:2454] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:37.237321 10281 raft_consensus.cc:2454] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:37.237722 10353 leader_election.cc:302] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:37.238014 10973 raft_consensus.cc:2781] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:37.238124 10973 raft_consensus.cc:482] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:37.238245 10973 raft_consensus.cc:3037] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.240690 10973 raft_consensus.cc:504] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.241636 10973 leader_election.cc:288] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:37.241705 10281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49c526a48d34b1d9560ca82c1ec794b" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:37.241919 10281 raft_consensus.cc:3037] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.241920 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49c526a48d34b1d9560ca82c1ec794b" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:37.242172 10144 raft_consensus.cc:3037] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:37.244597 10281 raft_consensus.cc:2454] T c49c526a48d34b1d9560ca82c1ec794b P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:37.244782 10144 raft_consensus.cc:2454] T c49c526a48d34b1d9560ca82c1ec794b P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:37.245079 10351 leader_election.cc:302] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:37.245489 10973 raft_consensus.cc:2781] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:37.245677 10973 raft_consensus.cc:686] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:37.246145 10973 consensus_queue.cc:237] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:37.281344 11081 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:37.281570 11081 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:37.282305 11081 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
I20260925 04:54:37.290807 10552 consensus_queue.cc:1035] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.306697 10552 consensus_queue.cc:1035] T 4ec88d2656214489b9b14f8517b549ad P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 04:54:37.309993 9939 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:37.321879 10998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 135 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:37.322592 10998 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 2.
I20260925 04:54:37.323556 9939 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc; no voters: 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:37.324095 11081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 04:54:37.324231 11081 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:37.324331 11081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 2 FOLLOWER]: Advancing to term 3
I20260925 04:54:37.327191 11081 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:37.327837 11081 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
I20260925 04:54:37.328321 10998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 135 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5"
I20260925 04:54:37.328522 10998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 2 FOLLOWER]: Advancing to term 3
W20260925 04:54:37.329200 9939 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:37.334149 10998 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 3.
I20260925 04:54:37.334494 9939 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc; no voters: 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:37.334889 11081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Leader election won for term 3
I20260925 04:54:37.335372 11081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 LEADER]: Becoming Leader. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Running, Role: LEADER
I20260925 04:54:37.335695 11081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 135, Committed index: 135, Last appended: 2.135, Last appended by leader: 135, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:37.337222 11087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 3 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:37.337584 11087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:37.343344 11089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:37.345672 10552 consensus_queue.cc:1035] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.346696 11089 catalog_manager.cc:669] Loaded metadata for table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:37.348938 11089 catalog_manager.cc:669] Loaded metadata for table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:37.350111 11089 catalog_manager.cc:669] Loaded metadata for table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:37.350697 11089 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:37.351158 11089 catalog_manager.cc:669] Loaded metadata for table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:37.351552 11089 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:37.351920 11089 catalog_manager.cc:669] Loaded metadata for table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:37.352319 11089 catalog_manager.cc:669] Loaded metadata for table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:37.354481 10552 consensus_queue.cc:1035] T 84148597a8b74a0a957c5fc9fd716429 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.355419 11089 tablet_loader.cc:96] loaded metadata for tablet 040e836f705e4023905c863618b8248c (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4])
I20260925 04:54:37.360610 11089 tablet_loader.cc:96] loaded metadata for tablet 4ec88d2656214489b9b14f8517b549ad (table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da])
I20260925 04:54:37.361789 11089 tablet_loader.cc:96] loaded metadata for tablet 689a7134c47543feaf5c453171ecb75a (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:37.362524 11089 tablet_loader.cc:96] loaded metadata for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:37.363040 11089 tablet_loader.cc:96] loaded metadata for tablet 84148597a8b74a0a957c5fc9fd716429 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:37.365592 11089 tablet_loader.cc:96] loaded metadata for tablet c49c526a48d34b1d9560ca82c1ec794b (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:37.367599 11089 tablet_loader.cc:96] loaded metadata for tablet e82ac233aa63482991098728b93ec1b6 (table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541])
I20260925 04:54:37.368322 11089 tablet_loader.cc:96] loaded metadata for tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:37.370141 11089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:37.372684 11089 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:37.372790 11089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:37.375798 11089 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:37.377432 11089 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Loaded TSK: 0
I20260925 04:54:37.378034 11089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:37.379524 11089 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:37.380976 11089 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 15
I20260925 04:54:37.409931 9950 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_374e8adb8ba2493996c57ce359e519b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:37.410470 9952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:37.410531 9949 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_7f50ccca03c042aeb74dd26f1ca15658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:37.410864 9945 master_service.cc:946] ReplaceTablet: received request to replace tablet 689a7134c47543feaf5c453171ecb75a from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:37.411082 9948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:37.411356 9948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:37.411685 9953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:37.411892 9953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:37.411715 9946 master_service.cc:946] ReplaceTablet: received request to replace tablet c49c526a48d34b1d9560ca82c1ec794b from {username='slave'} at 127.0.0.1:60174
I20260925 04:54:37.411960 9944 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:37.410070 9947 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_41a0c852a29745399a4b27608bae6f60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:37.412199 9944 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:37.412573 9951 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60174:
name: "default.Table_4a0c924d2d034690b79dd3b5cba5b781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:37.410789 9952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60174:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:37.416712 10998 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Refusing update from remote peer 39da3a5fade344af9db436d10052b4bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 28. Preceding OpId from leader: term: 3 index: 137. (index mismatch)
W20260925 04:54:37.416921 9939 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc -> Peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Couldn't send request to peer 9c78f840b646474a98deff6bac54d5cc. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:37.417946 11081 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 136, Last known committed idx: 27, Time since last communication: 0.000s
I20260925 04:54:37.420105 10009 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
W20260925 04:54:37.420454 10009 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:37.420557 10009 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
@ 0x7f6acb6889ad google::LogMessage::Fail() at ??:0
@ 0x7f6acb68b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6acb6884de google::LogMessage::Flush() at ??:0
@ 0x7f6acb6886d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f6ae1226ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f6ae1225901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f6ae122c66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f6ae122c4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6ace2b2eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6ad158c6db start_thread at ??:0
@ 0x7f6aca52261f clone at ??:0
I20260925 04:54:37.461191 11094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 3 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:37.461630 11094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:37.462646 11094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:37.462950 11094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:37.509373 11098 mvcc.cc:205] Tried to move back new op lower bound from 7333118269092601856 to 7333118268769558528. Current Snapshot: MvccSnapshot[applied={T|T < 7333118269092601856}]
I20260925 04:54:37.596346 10973 consensus_queue.cc:1035] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.603127 10973 consensus_queue.cc:1035] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 04:54:37.640337 10353 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:37.640523 10079 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:37.641048 10472 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:37.641516 10472 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:37.641769 10922 connection.cc:535] server connection from 127.0.0.1:44164 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:37.641870 10472 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.188:40705)
W20260925 04:54:37.642409 10472 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:37.642496 10218 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 04:54:37.782842 10973 consensus_queue.cc:1035] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.787953 10803 consensus_queue.cc:1035] T 7ec2296f1d414013bb2699ed9fd7d2fc P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.882426 10803 consensus_queue.cc:1035] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.887068 10803 consensus_queue.cc:1035] T 040e836f705e4023905c863618b8248c P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:37.963274 11094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:37.963490 11094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:37.965164 11094 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:37.966284 10929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:37.967551 10925 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:37.967804 10929 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:37.967960 10929 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:37.968211 11094 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 04:54:38.090957 10552 consensus_queue.cc:1035] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:38.097344 11126 consensus_queue.cc:1035] T e82ac233aa63482991098728b93ec1b6 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:38.230120 10803 consensus_queue.cc:1035] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:38.234387 10973 consensus_queue.cc:1035] T c49c526a48d34b1d9560ca82c1ec794b P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:38.587845 11132 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:38.588028 11132 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:38.588586 11132 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:38.590883 10925 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:38.591099 10929 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:38.591261 10929 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:38.591526 11132 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 04:54:39.369318 11147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:39.369472 11147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:39.370121 11147 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:39.371934 10925 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:39.372124 10929 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:39.372284 10929 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:39.372522 11147 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 04:54:39.833801 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--webserver_interface=127.9.81.189
--webserver_port=36963
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:40.015149 10970 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:40.015323 10970 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:40.016065 10970 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:40.016994 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:40.017159 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:40.017256 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:40.017544 10970 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 04:54:40.165140 11155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:40.165592 11155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:40.165728 11155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:40.173818 11155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:40.173908 11155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:40.174000 11155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:40.174073 11155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:40.183394 11155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.81.189
--webserver_port=36963
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:40.185106 11155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:40.186906 11155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:40.198489 11166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:40.198518 11168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:40.198768 11165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:40.199380 11155 server_base.cc:1034] running on GCE node
I20260925 04:54:40.200182 11155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:40.201579 11155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:40.202785 11155 hybrid_clock.cc:648] HybridClock initialized: now 1790312080202712 us; error 48 us; skew 500 ppm
I20260925 04:54:40.203101 11155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:40.205449 11155 webserver.cc:460] Webserver started at http://127.9.81.189:36963/ using document root <none> and password file <none>
I20260925 04:54:40.206131 11155 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:40.206259 11155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:40.211187 11155 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260925 04:54:40.213837 11174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:40.215080 11155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260925 04:54:40.215251 11155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:40.216154 11155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:40.233428 11155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:40.234258 11155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:40.234596 11155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:40.253897 11155 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.189:45475
I20260925 04:54:40.253937 11227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.189:45475 every 8 connection(s)
I20260925 04:54:40.255291 11155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
I20260925 04:54:40.256196 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11155
I20260925 04:54:40.268886 11228 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:40.274874 11228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap starting.
I20260925 04:54:40.304971 11228 log.cc:824] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:40.400774 11228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=135 overwritten=0 applied=135 ignored=0} inserts{seen=78 ignored=0} mutations{seen=130 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 04:54:40.401391 11228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap complete.
I20260925 04:54:40.414187 11228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:40.415637 11228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Initialized, Role: FOLLOWER
I20260925 04:54:40.416363 11228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 135, Last appended: 2.135, Last appended by leader: 135, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:40.416661 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:40.417265 11235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:40.417694 11235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:40.418488 11228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:40.451282 11249 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:40.451399 11249 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: success
I20260925 04:54:40.457873 11249 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: acquiring CA information for follower catalog manager: success
I20260925 04:54:40.462510 11249 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:40.468070 10329 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:40.472260 11193 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:50889; Asking this server to re-register.
I20260925 04:54:40.473057 10329 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:40.475406 11193 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:40.481909 11155 master_runner.cc:186] Error getting master registration for 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111),
I20260925 04:54:40.488174 11155 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:40.659657 11256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:40.659866 11256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:40.660554 11256 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:40.663836 10929 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:40.669291 11203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 138 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:40.670053 11203 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37499e1d150b41169507d4dd098579b5 in term 2.
I20260925 04:54:40.670717 10925 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:40.671072 11256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 04:54:40.671198 11256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:40.671304 11256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 04:54:40.673862 11256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:40.674489 11256 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 election: Requested vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:40.674842 11203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37499e1d150b41169507d4dd098579b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 138 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc"
I20260925 04:54:40.675038 11203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 2 FOLLOWER]: Advancing to term 4
W20260925 04:54:40.676258 10929 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:40.679772 11203 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37499e1d150b41169507d4dd098579b5 in term 4.
I20260925 04:54:40.680176 10925 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:40.680437 11256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 04:54:40.680886 11256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 LEADER]: Becoming Leader. State: Replica: 37499e1d150b41169507d4dd098579b5, State: Running, Role: LEADER
I20260925 04:54:40.681319 11256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 3.138, Last appended by leader: 138, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:40.682818 11260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37499e1d150b41169507d4dd098579b5. Latest consensus state: current_term: 4 leader_uuid: "37499e1d150b41169507d4dd098579b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:40.683130 11260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:40.683848 11262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:40.686785 11262 catalog_manager.cc:669] Loaded metadata for table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:40.687233 11262 catalog_manager.cc:669] Loaded metadata for table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:40.687588 11262 catalog_manager.cc:669] Loaded metadata for table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:40.687913 11262 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:40.688233 11262 catalog_manager.cc:669] Loaded metadata for table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:40.688568 11262 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:40.688886 11262 catalog_manager.cc:669] Loaded metadata for table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:40.689265 11262 catalog_manager.cc:669] Loaded metadata for table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:40.691740 11262 tablet_loader.cc:96] loaded metadata for tablet 040e836f705e4023905c863618b8248c (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4])
I20260925 04:54:40.692480 11262 tablet_loader.cc:96] loaded metadata for tablet 136735419750408da66a0472736a4452 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:40.695199 11262 tablet_loader.cc:96] loaded metadata for tablet 4ec88d2656214489b9b14f8517b549ad (table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da])
I20260925 04:54:40.696409 11262 tablet_loader.cc:96] loaded metadata for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:40.696839 11262 tablet_loader.cc:96] loaded metadata for tablet 84148597a8b74a0a957c5fc9fd716429 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:40.698962 11262 tablet_loader.cc:96] loaded metadata for tablet d9a959c2af544383a2f2907dc26364e8 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:40.700644 11262 tablet_loader.cc:96] loaded metadata for tablet e82ac233aa63482991098728b93ec1b6 (table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541])
I20260925 04:54:40.701454 11262 tablet_loader.cc:96] loaded metadata for tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:40.702790 11262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:40.704795 11262 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:40.704906 11262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:40.706957 11262 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:40.708568 11262 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Loaded TSK: 0
I20260925 04:54:40.709514 11262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:40.711046 11262 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:40.712563 11262 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 15
I20260925 04:54:40.750644 10191 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:40.753304 11193 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:35101; Asking this server to re-register.
I20260925 04:54:40.754061 10191 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:40.756062 11193 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:40.759171 10977 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44148:
name: "default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:40.759663 10963 master_service.cc:946] ReplaceTablet: received request to replace tablet 84148597a8b74a0a957c5fc9fd716429 from {username='slave'} at 127.0.0.1:44148
I20260925 04:54:40.760354 10955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44148:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:40.760689 10955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44148:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:40.761243 10958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44148:
name: "default.Table_80d05ca86f934088be48a6989b971ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:40.762714 10953 master_service.cc:946] ReplaceTablet: received request to replace tablet cc10d812f78a47258ed9b6e5726e54fb from {username='slave'} at 127.0.0.1:44148
I20260925 04:54:40.763617 10953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44148:
name: "default.Table_273e0dfb03e648e4b9fd3a8abf07a709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:40.764549 10967 master_service.cc:946] ReplaceTablet: received request to replace tablet c49c526a48d34b1d9560ca82c1ec794b from {username='slave'} at 127.0.0.1:44148
I20260925 04:54:40.765452 10976 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44148:
table { table_name: "default.Table_421a98a632c24f8296c302eef981e44f" } new_table_name: "default.Table_082709c0f7b0469a83d4fb0e9002f8a5" modify_external_catalogs: true
I20260925 04:54:40.765710 10978 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44148:
name: "default.Table_9a7f064f807444c69ef2ae958de42e7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:40.766449 10961 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44148:
name: "default.Table_1d5987cf0ad94f428a8c5ad200753709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:40.766928 10967 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44148:
table { table_name: "default.Table_c4023953be09425f877d1e8a30f45361" } new_table_name: "default.Table_48a023979ead4432a298d53c804329da" modify_external_catalogs: true
I20260925 04:54:40.767558 10968 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44148:
table { table_name: "default.Table_046291a687f44532af93aec0cf2df2c4" } new_table_name: "default.Table_1a741086c07f44e88bab2ccc1735fd67" modify_external_catalogs: true
I20260925 04:54:40.768525 11203 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Refusing update from remote peer 37499e1d150b41169507d4dd098579b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 135. Preceding OpId from leader: term: 4 index: 140. (index mismatch)
I20260925 04:54:40.769333 11260 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 135, Time since last communication: 0.000s
W20260925 04:54:40.771024 10929 consensus_peers.cc:487] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 -> Peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Couldn't send request to peer 39da3a5fade344af9db436d10052b4bc. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:40.776163 11065 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
W20260925 04:54:40.776603 11065 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:40.776763 11065 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
@ 0x7f7cbc32f9ad google::LogMessage::Fail() at ??:0
@ 0x7f7cbc33288a google::LogMessage::SendToLog() at ??:0
@ 0x7f7cbc32f4de google::LogMessage::Flush() at ??:0
@ 0x7f7cbc32f6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f7cd1ecdba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f7cd1ecc901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f7cd1ed366c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f7cd1ed34e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f7cbef59eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7cc22336db start_thread at ??:0
@ 0x7f7cbb1c961f clone at ??:0
I20260925 04:54:40.828159 11270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "37499e1d150b41169507d4dd098579b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:40.828544 11270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:40.828187 11235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37499e1d150b41169507d4dd098579b5. Latest consensus state: current_term: 4 leader_uuid: "37499e1d150b41169507d4dd098579b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:40.829592 11235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:40.921439 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:40.923406 11193 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:36237; Asking this server to re-register.
I20260925 04:54:40.924090 10464 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:40.925393 11193 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
W20260925 04:54:41.002664 10217 connection.cc:535] client connection to 127.9.81.190:37617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:41.002664 11178 connection.cc:535] server connection from 127.0.0.1:53628 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:41.003207 10352 connection.cc:535] client connection to 127.9.81.190:37617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:41.003729 10471 connection.cc:535] client connection to 127.9.81.190:37617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:41.004443 10471 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.190:37617)
W20260925 04:54:41.004838 10471 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.190:37617)
W20260925 04:54:41.005406 10471 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.190:37617)
W20260925 04:54:41.005827 10471 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.190:37617)
I20260925 04:54:41.247731 10190 heartbeater.cc:503] Master 127.9.81.190:37617 was elected leader, sending a full tablet report...
I20260925 04:54:41.272159 11235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37499e1d150b41169507d4dd098579b5)
I20260925 04:54:41.272341 11235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:41.274166 11235 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:41.275328 11177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:41.276619 11177 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:41.276798 11178 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:41.276952 11178 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:41.277338 11235 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 04:54:42.001801 11289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37499e1d150b41169507d4dd098579b5)
I20260925 04:54:42.001989 11289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:42.002766 11289 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:42.005245 11178 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:42.005420 11177 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:42.005555 11177 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:42.005816 11289 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 04:54:42.888543 11293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37499e1d150b41169507d4dd098579b5)
I20260925 04:54:42.888768 11293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:42.889506 11293 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:42.891896 11177 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:42.892068 11178 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:42.892199 11178 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:42.892473 11293 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 04:54:43.303941 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--webserver_interface=127.9.81.188
--webserver_port=37703
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 04:54:43.506486 10970 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:43.506703 10970 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:43.507404 10970 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:43.508351 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:43.508826 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:43.508944 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:43.509260 10970 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 04:54:43.627038 11297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:43.627364 11297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:43.627521 11297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:43.635267 11297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:43.635391 11297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:43.635473 11297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:43.635592 11297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:43.645658 11297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.81.188
--webserver_port=37703
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:43.646896 11297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:43.648537 11297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:43.659987 11302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:43.659962 11303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:43.660531 11305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:43.660688 11297 server_base.cc:1034] running on GCE node
I20260925 04:54:43.661566 11297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:43.662833 11297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:43.664041 11297 hybrid_clock.cc:648] HybridClock initialized: now 1790312083663971 us; error 50 us; skew 500 ppm
I20260925 04:54:43.664367 11297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:43.670622 11297 webserver.cc:460] Webserver started at http://127.9.81.188:37703/ using document root <none> and password file <none>
I20260925 04:54:43.671387 11297 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:43.671545 11297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:43.676498 11297 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:43.679267 11311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:43.680626 11297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:43.680805 11297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
uuid: "39da3a5fade344af9db436d10052b4bc"
format_stamp: "Formatted at 2026-09-25 04:54:27 on dist-test-slave-qkh6"
I20260925 04:54:43.681816 11297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:43.698158 11297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:43.698931 11297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:43.699265 11297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:43.718421 11297 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.188:40705
I20260925 04:54:43.718452 11362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.188:40705 every 8 connection(s)
I20260925 04:54:43.720119 11297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
I20260925 04:54:43.720893 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11297
I20260925 04:54:43.729107 11363 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:43.733723 11363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap starting.
I20260925 04:54:43.755910 11363 log.cc:824] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:43.756721 10189 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:43.865564 11363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=138 overwritten=0 applied=136 ignored=0} inserts{seen=78 ignored=0} mutations{seen=130 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260925 04:54:43.866216 11363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap complete.
I20260925 04:54:43.873926 11363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:43.877163 11363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Initialized, Role: FOLLOWER
I20260925 04:54:43.877749 11363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 136, Last appended: 3.138, Last appended by leader: 138, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:43.878513 11369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:43.878813 11369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:43.879525 11363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:43.893898 11383 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:43.894090 11383 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: loading cluster ID for follower catalog manager: success
I20260925 04:54:43.889246 11297 master_runner.cc:186] Error getting master registration for 127.9.81.190:37617: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111),
I20260925 04:54:43.899142 11297 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:43.899765 11383 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: acquiring CA information for follower catalog manager: success
I20260925 04:54:43.903740 11383 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:43.925976 10462 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:43.929343 11328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:52505; Asking this server to re-register.
I20260925 04:54:43.930039 10462 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:43.931742 11328 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:43.982378 10327 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:43.984473 11328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:33211; Asking this server to re-register.
I20260925 04:54:43.985160 10327 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:43.986553 11328 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:44.261492 11328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:55055; Asking this server to re-register.
I20260925 04:54:44.262218 10189 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:44.264497 11327 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:44.293468 11369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:44.293812 11369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:44.295593 11369 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:44.296888 11314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:44.299007 11314 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:44.304311 11203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 138 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:44.304615 11203 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39da3a5fade344af9db436d10052b4bc in current term 4: Already voted for candidate 37499e1d150b41169507d4dd098579b5 in this term.
I20260925 04:54:44.305374 11314 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:44.305732 11369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 3 FOLLOWER]: Advancing to term 4
I20260925 04:54:44.309190 11369 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 04:54:44.542419 11392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37499e1d150b41169507d4dd098579b5)
I20260925 04:54:44.542618 11392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:44.543290 11392 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:44.545709 11177 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:44.550627 11338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 5 candidate_status { last_received { term: 4 index: 140 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc" is_pre_election: true
I20260925 04:54:44.551046 11338 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 4.
I20260925 04:54:44.551537 11178 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5
I20260925 04:54:44.551841 11392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 04:54:44.551957 11392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37499e1d150b41169507d4dd098579b5)
I20260925 04:54:44.552032 11392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 4 FOLLOWER]: Advancing to term 5
I20260925 04:54:44.554168 11392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:44.554677 11392 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:44.555133 11338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 5 candidate_status { last_received { term: 4 index: 140 } } ignore_live_leader: false dest_uuid: "39da3a5fade344af9db436d10052b4bc"
I20260925 04:54:44.555361 11338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 4 FOLLOWER]: Advancing to term 5
W20260925 04:54:44.555869 11177 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:44.557557 11338 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 5.
I20260925 04:54:44.557878 11178 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5
I20260925 04:54:44.558130 11392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Leader election won for term 5
I20260925 04:54:44.558573 11392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 LEADER]: Becoming Leader. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Running, Role: LEADER
I20260925 04:54:44.559032 11392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 4.140, Last appended by leader: 140, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:44.560599 11397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:44.560894 11397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:45.023921 11338 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Refusing update from remote peer 9c78f840b646474a98deff6bac54d5cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 138. Preceding OpId from leader: term: 5 index: 141. (index mismatch)
I20260925 04:54:45.024720 11397 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 136, Time since last communication: 0.000s
I20260925 04:54:45.030005 11403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:45.030313 11403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:45.032924 11403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:45.033171 11403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:45.033862 11410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:45.034248 11410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:45.034752 11397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:45.034752 11392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:45.035121 11397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:45.035144 11392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
W20260925 04:54:45.035549 11177 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc -> Peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Couldn't send request to peer 37499e1d150b41169507d4dd098579b5. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:45.077657 11399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:45.080967 11399 catalog_manager.cc:669] Loaded metadata for table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:45.081501 11399 catalog_manager.cc:669] Loaded metadata for table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:45.081844 11399 catalog_manager.cc:669] Loaded metadata for table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:45.082175 11399 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:45.082510 11399 catalog_manager.cc:669] Loaded metadata for table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:45.082844 11399 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:45.083153 11399 catalog_manager.cc:669] Loaded metadata for table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:45.083503 11399 catalog_manager.cc:669] Loaded metadata for table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:45.086058 11399 tablet_loader.cc:96] loaded metadata for tablet 040e836f705e4023905c863618b8248c (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4])
I20260925 04:54:45.086813 11399 tablet_loader.cc:96] loaded metadata for tablet 136735419750408da66a0472736a4452 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:45.088896 11399 tablet_loader.cc:96] loaded metadata for tablet 4ec88d2656214489b9b14f8517b549ad (table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da])
I20260925 04:54:45.089319 11399 tablet_loader.cc:96] loaded metadata for tablet 563a34c7c5c3448f8f3e391eb105fb84 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:45.090342 11399 tablet_loader.cc:96] loaded metadata for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:45.092537 11399 tablet_loader.cc:96] loaded metadata for tablet d9a959c2af544383a2f2907dc26364e8 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:45.093691 11399 tablet_loader.cc:96] loaded metadata for tablet e82ac233aa63482991098728b93ec1b6 (table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541])
I20260925 04:54:45.094242 11399 tablet_loader.cc:96] loaded metadata for tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:45.095338 11399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:45.096982 11399 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:45.097106 11399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:45.098986 11399 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:45.100869 11399 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Loaded TSK: 0
I20260925 04:54:45.101796 11399 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:45.103367 11399 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:45.104909 11399 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 15
I20260925 04:54:45.122907 11193 master_service.cc:946] ReplaceTablet: received request to replace tablet 590c902ec8ea41679146d82b058e01e3 from {username='slave'} at 127.0.0.1:53606
I20260925 04:54:45.122983 11192 master_service.cc:946] ReplaceTablet: received request to replace tablet ed3266630f274ef58f1a95fbd5aaf559 from {username='slave'} at 127.0.0.1:53606
I20260925 04:54:45.124125 11185 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:45.124042 11187 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_7f50ccca03c042aeb74dd26f1ca15658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.124512 11185 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_97aab5f07e904b7580396563fdcec71e" } modify_external_catalogs: true
I20260925 04:54:45.125154 11182 master_service.cc:946] ReplaceTablet: received request to replace tablet 84148597a8b74a0a957c5fc9fd716429 from {username='slave'} at 127.0.0.1:53606
I20260925 04:54:45.125352 11189 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_374e8adb8ba2493996c57ce359e519b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.125905 11186 master_service.cc:946] ReplaceTablet: received request to replace tablet c49c526a48d34b1d9560ca82c1ec794b from {username='slave'} at 127.0.0.1:53606
I20260925 04:54:45.126184 11182 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_046291a687f44532af93aec0cf2df2c4" } new_table_name: "default.Table_1a741086c07f44e88bab2ccc1735fd67" modify_external_catalogs: true
I20260925 04:54:45.126621 11184 master_service.cc:946] ReplaceTablet: received request to replace tablet 689a7134c47543feaf5c453171ecb75a from {username='slave'} at 127.0.0.1:53606
I20260925 04:54:45.127215 11183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:45.127921 11183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:45.127645 11188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_41a0c852a29745399a4b27608bae6f60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.128372 11186 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53606:
table { table_name: "default.Table_421a98a632c24f8296c302eef981e44f" } new_table_name: "default.Table_082709c0f7b0469a83d4fb0e9002f8a5" modify_external_catalogs: true
I20260925 04:54:45.129019 11184 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_9a7f064f807444c69ef2ae958de42e7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.129878 11193 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.131016 11192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet ed3266630f274ef58f1a95fbd5aaf559
I20260925 04:54:45.137584 11248 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
W20260925 04:54:45.138063 11248 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:45.138186 11248 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
@ 0x7f64b51309ad google::LogMessage::Fail() at ??:0
@ 0x7f64b513388a google::LogMessage::SendToLog() at ??:0
@ 0x7f64b51304de google::LogMessage::Flush() at ??:0
@ 0x7f64b51306d1 google::LogMessage::~LogMessage() at ??:0
I20260925 04:54:45.149271 11192 catalog_manager.cc:6565] ReplaceTablet: tablet ed3266630f274ef58f1a95fbd5aaf559 deleted and replaced by tablet 35c500721e7e40e8a191c3f6849a5b3f
I20260925 04:54:45.149688 11192 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53606:
name: "default.Table_1d5987cf0ad94f428a8c5ad200753709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:45.162500 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 with delete_type TABLET_DATA_DELETED (replaced by tablet 35c500721e7e40e8a191c3f6849a5b3f) from {username='slave'} at 127.0.0.1:53006
I20260925 04:54:45.163049 10121 tablet_service.cc:1467] Processing CreateTablet for tablet d9a959c2af544383a2f2907dc26364e8 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.163218 10119 tablet_service.cc:1467] Processing CreateTablet for tablet 563a34c7c5c3448f8f3e391eb105fb84 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.163421 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a959c2af544383a2f2907dc26364e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.163740 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 563a34c7c5c3448f8f3e391eb105fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.163941 10120 tablet_service.cc:1467] Processing CreateTablet for tablet 136735419750408da66a0472736a4452 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.164265 10120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136735419750408da66a0472736a4452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.169258 10122 tablet_service.cc:1467] Processing CreateTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.169703 10122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35c500721e7e40e8a191c3f6849a5b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.182353 11422 tablet_replica.cc:330] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
@ 0x7f64cacceba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260925 04:54:45.184846 11422 raft_consensus.cc:2229] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:45.185406 11422 raft_consensus.cc:2258] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:45.186013 11422 ts_tablet_manager.cc:1905] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:45.194600 11422 ts_tablet_manager.cc:1918] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:45.194743 11422 log.cc:1196] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/ed3266630f274ef58f1a95fbd5aaf559
I20260925 04:54:45.195219 11422 ts_tablet_manager.cc:1939] T ed3266630f274ef58f1a95fbd5aaf559 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:45.196558 11178 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:45.196748 10262 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 with delete_type TABLET_DATA_DELETED (replaced by tablet 35c500721e7e40e8a191c3f6849a5b3f) from {username='slave'} at 127.0.0.1:60864
I20260925 04:54:45.197208 10260 tablet_service.cc:1467] Processing CreateTablet for tablet d9a959c2af544383a2f2907dc26364e8 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.197280 10261 tablet_service.cc:1467] Processing CreateTablet for tablet 563a34c7c5c3448f8f3e391eb105fb84 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.197580 10259 tablet_service.cc:1467] Processing CreateTablet for tablet 136735419750408da66a0472736a4452 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.197736 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a959c2af544383a2f2907dc26364e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.198109 10259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136735419750408da66a0472736a4452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.198313 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 563a34c7c5c3448f8f3e391eb105fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.198850 10258 tablet_service.cc:1467] Processing CreateTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.199330 10258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35c500721e7e40e8a191c3f6849a5b3f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f64caccd901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260925 04:54:45.215133 11425 tablet_replica.cc:330] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:45.215380 11425 raft_consensus.cc:2229] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:45.215663 11425 raft_consensus.cc:2258] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:45.216317 11425 ts_tablet_manager.cc:1905] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f64cacd466c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f64cacd44e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260925 04:54:45.224946 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3266630f274ef58f1a95fbd5aaf559 with delete_type TABLET_DATA_DELETED (replaced by tablet 35c500721e7e40e8a191c3f6849a5b3f) from {username='slave'} at 127.0.0.1:39056
I20260925 04:54:45.225204 10397 tablet_service.cc:1467] Processing CreateTablet for tablet 136735419750408da66a0472736a4452 (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260925 04:54:45.226022 10396 tablet_service.cc:1467] Processing CreateTablet for tablet d9a959c2af544383a2f2907dc26364e8 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.225626 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 563a34c7c5c3448f8f3e391eb105fb84 (DEFAULT_TABLE table=default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.226727 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136735419750408da66a0472736a4452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.226928 11428 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:45.229053 10393 tablet_service.cc:1467] Processing CreateTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:45.229350 11428 tablet_bootstrap.cc:654] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.229514 10393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35c500721e7e40e8a191c3f6849a5b3f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f64b7d5aeaf kudu::Thread::SuperviseThread() at ??:0
I20260925 04:54:45.231585 11423 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
@ 0x7f64bb0346db start_thread at ??:0
I20260925 04:54:45.232941 11423 tablet_bootstrap.cc:654] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.233100 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a959c2af544383a2f2907dc26364e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.234323 11428 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:45.234534 11428 ts_tablet_manager.cc:1397] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260925 04:54:45.235697 11428 raft_consensus.cc:348] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.236027 11428 raft_consensus.cc:374] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.236138 11428 raft_consensus.cc:729] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.236555 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 563a34c7c5c3448f8f3e391eb105fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:45.236629 11428 consensus_queue.cc:260] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.237015 11425 ts_tablet_manager.cc:1918] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:45.237142 11425 log.cc:1196] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/ed3266630f274ef58f1a95fbd5aaf559
I20260925 04:54:45.237558 11425 ts_tablet_manager.cc:1939] T ed3266630f274ef58f1a95fbd5aaf559 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:45.238562 11176 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet ed3266630f274ef58f1a95fbd5aaf559 (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:45.239513 11428 ts_tablet_manager.cc:1428] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260925 04:54:45.239869 11428 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
@ 0x7f64b3fca61f clone at ??:0
I20260925 04:54:45.242410 11428 tablet_bootstrap.cc:654] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.244675 11423 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:45.244804 11423 ts_tablet_manager.cc:1397] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260925 04:54:45.245410 11428 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:45.245584 11428 ts_tablet_manager.cc:1397] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260925 04:54:45.245667 11423 raft_consensus.cc:348] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.245906 11423 raft_consensus.cc:374] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.245986 11423 raft_consensus.cc:729] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.246239 11423 consensus_queue.cc:260] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.246454 11428 raft_consensus.cc:348] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.246734 11428 raft_consensus.cc:374] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.246819 11428 raft_consensus.cc:729] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.247108 11428 consensus_queue.cc:260] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.251492 11428 ts_tablet_manager.cc:1428] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 04:54:45.255244 11428 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:45.257263 11428 tablet_bootstrap.cc:654] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.258729 11433 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:45.261492 11428 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:45.261615 11428 ts_tablet_manager.cc:1397] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260925 04:54:45.261961 11433 tablet_bootstrap.cc:654] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.262383 11428 raft_consensus.cc:348] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.262616 11428 raft_consensus.cc:374] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.262704 11428 raft_consensus.cc:729] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.262984 11428 consensus_queue.cc:260] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.267233 11428 ts_tablet_manager.cc:1428] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 04:54:45.268597 11428 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:45.269264 11429 tablet_replica.cc:330] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:45.269471 11429 raft_consensus.cc:2229] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:45.269914 11429 raft_consensus.cc:2258] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:45.270479 11429 ts_tablet_manager.cc:1905] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:45.270599 11428 tablet_bootstrap.cc:654] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.276295 11423 ts_tablet_manager.cc:1428] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.031s user 0.003s sys 0.010s
I20260925 04:54:45.277724 11429 ts_tablet_manager.cc:1918] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:45.277845 11429 log.cc:1196] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/ed3266630f274ef58f1a95fbd5aaf559
I20260925 04:54:45.278296 11429 ts_tablet_manager.cc:1939] T ed3266630f274ef58f1a95fbd5aaf559 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:45.279872 11423 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:45.289903 11433 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:45.290040 11433 ts_tablet_manager.cc:1397] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.005s
I20260925 04:54:45.290819 11433 raft_consensus.cc:348] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.291034 11433 raft_consensus.cc:374] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.291113 11433 raft_consensus.cc:729] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.291327 11433 consensus_queue.cc:260] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.292070 11433 ts_tablet_manager.cc:1428] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 04:54:45.292346 11433 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:45.293839 11428 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:45.294004 11428 ts_tablet_manager.cc:1397] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.008s
I20260925 04:54:45.294253 11433 tablet_bootstrap.cc:654] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.294703 11428 raft_consensus.cc:348] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.294937 11428 raft_consensus.cc:374] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.295004 11428 raft_consensus.cc:729] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.295251 11428 consensus_queue.cc:260] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.298324 11428 ts_tablet_manager.cc:1428] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 04:54:45.298735 11433 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:45.298823 11423 tablet_bootstrap.cc:654] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.298874 11433 ts_tablet_manager.cc:1397] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260925 04:54:45.299598 11433 raft_consensus.cc:348] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.299938 11433 raft_consensus.cc:374] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.300007 11433 raft_consensus.cc:729] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.300289 11433 consensus_queue.cc:260] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.303349 11433 ts_tablet_manager.cc:1428] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260925 04:54:45.306620 11433 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:45.308106 11433 tablet_bootstrap.cc:654] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.314314 11433 tablet_bootstrap.cc:492] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:45.314456 11433 ts_tablet_manager.cc:1397] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260925 04:54:45.315156 11433 raft_consensus.cc:348] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.315395 11433 raft_consensus.cc:374] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.315501 11433 raft_consensus.cc:729] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.315750 11433 consensus_queue.cc:260] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.318861 11423 tablet_bootstrap.cc:492] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:45.319043 11423 ts_tablet_manager.cc:1397] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.003s
I20260925 04:54:45.319916 11423 raft_consensus.cc:348] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.320194 11423 raft_consensus.cc:374] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.320271 11423 raft_consensus.cc:729] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.320544 11423 consensus_queue.cc:260] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.321969 11423 ts_tablet_manager.cc:1428] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260925 04:54:45.324734 11423 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:45.336017 11423 tablet_bootstrap.cc:654] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.337675 11433 ts_tablet_manager.cc:1428] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260925 04:54:45.338303 11433 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:45.339838 11433 tablet_bootstrap.cc:654] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.340931 11423 tablet_bootstrap.cc:492] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:45.341130 11423 ts_tablet_manager.cc:1397] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260925 04:54:45.342124 11423 raft_consensus.cc:348] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.342446 11423 raft_consensus.cc:374] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.342552 11423 raft_consensus.cc:729] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.342803 11423 consensus_queue.cc:260] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.343446 11423 ts_tablet_manager.cc:1428] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:45.343878 11423 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:45.345548 11423 tablet_bootstrap.cc:654] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:45.347360 11423 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:45.347532 11423 ts_tablet_manager.cc:1397] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260925 04:54:45.348061 11423 raft_consensus.cc:348] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.348309 11423 raft_consensus.cc:374] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.348421 11423 raft_consensus.cc:729] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.348647 11423 consensus_queue.cc:260] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.349152 11423 ts_tablet_manager.cc:1428] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:45.349700 11433 tablet_bootstrap.cc:492] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:45.349874 11433 ts_tablet_manager.cc:1397] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260925 04:54:45.350586 11433 raft_consensus.cc:348] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.350826 11433 raft_consensus.cc:374] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:45.350924 11433 raft_consensus.cc:729] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:45.351147 11433 consensus_queue.cc:260] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.351673 11433 ts_tablet_manager.cc:1428] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:45.465318 11449 raft_consensus.cc:482] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:45.465483 11449 raft_consensus.cc:504] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.466145 11449 leader_election.cc:288] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:45.466665 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a959c2af544383a2f2907dc26364e8" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:45.466713 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a959c2af544383a2f2907dc26364e8" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:45.466925 10144 raft_consensus.cc:2454] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:45.466950 10282 raft_consensus.cc:2454] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:45.467389 10353 leader_election.cc:302] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:45.467649 11449 raft_consensus.cc:2781] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:45.467779 11449 raft_consensus.cc:482] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:45.467871 11449 raft_consensus.cc:3037] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.471195 11449 raft_consensus.cc:504] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.471881 11449 leader_election.cc:288] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:45.472221 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a959c2af544383a2f2907dc26364e8" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:45.472304 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a959c2af544383a2f2907dc26364e8" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:45.472455 10282 raft_consensus.cc:3037] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.472539 10144 raft_consensus.cc:3037] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.474483 10144 raft_consensus.cc:2454] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:45.474867 10353 leader_election.cc:302] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:45.475126 11449 raft_consensus.cc:2781] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:45.475267 11449 raft_consensus.cc:686] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:45.475517 11449 consensus_queue.cc:237] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.475668 10282 raft_consensus.cc:2454] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
W20260925 04:54:45.476703 10351 connection.cc:535] server connection from 127.0.0.1:39056 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:45.477427 10078 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:45.477635 10471 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:45.477715 10217 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:45.478628 10471 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.189:45475)
W20260925 04:54:45.479315 10471 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:45.479565 10471 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:45.479730 10352 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:45.480038 10471 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:45.481932 11402 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:45.478774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.130:48017)
0925 04:54:45.479006 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:45.479025 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:45.479141 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:45.481641 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126}
W20260925 04:54:45.482800 11401 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:45.480550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.131:58803)
0925 04:54:45.480805 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:45.480832 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:45.480936 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:45.482522 (+ 1586us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":147}
W20260925 04:54:45.483053 11435 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:45.479475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.129:40909)
0925 04:54:45.479655 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:45.479679 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:45.479787 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:45.482684 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":61}
I20260925 04:54:45.540858 11449 raft_consensus.cc:482] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:45.541113 11449 raft_consensus.cc:504] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.541743 11449 leader_election.cc:288] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:45.542156 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "563a34c7c5c3448f8f3e391eb105fb84" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:45.542264 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "563a34c7c5c3448f8f3e391eb105fb84" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:45.542371 10282 raft_consensus.cc:2454] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:45.542593 10144 raft_consensus.cc:2454] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:45.542801 10351 leader_election.cc:302] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:45.543081 11449 raft_consensus.cc:2781] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:45.543172 11449 raft_consensus.cc:482] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:45.543272 11449 raft_consensus.cc:3037] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.545707 11449 raft_consensus.cc:504] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.546188 11449 leader_election.cc:288] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:45.546602 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "563a34c7c5c3448f8f3e391eb105fb84" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:45.546633 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "563a34c7c5c3448f8f3e391eb105fb84" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:45.546772 10282 raft_consensus.cc:3037] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.546824 10144 raft_consensus.cc:3037] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.548623 10282 raft_consensus.cc:2454] T 563a34c7c5c3448f8f3e391eb105fb84 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:45.548630 10144 raft_consensus.cc:2454] T 563a34c7c5c3448f8f3e391eb105fb84 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:45.549002 10351 leader_election.cc:302] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:45.549260 11449 raft_consensus.cc:2781] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:45.549484 11449 raft_consensus.cc:686] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:45.549856 11449 consensus_queue.cc:237] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.552155 11434 raft_consensus.cc:482] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:45.552332 11434 raft_consensus.cc:504] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.553092 11434 leader_election.cc:288] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:45.553450 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35c500721e7e40e8a191c3f6849a5b3f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:45.553660 10282 raft_consensus.cc:2454] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:45.553668 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35c500721e7e40e8a191c3f6849a5b3f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:45.553896 10416 raft_consensus.cc:2454] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:45.554050 10077 leader_election.cc:302] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:45.554298 11434 raft_consensus.cc:2781] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:45.554399 11434 raft_consensus.cc:482] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:45.554503 11434 raft_consensus.cc:3037] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.556258 11434 raft_consensus.cc:504] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.556711 11434 leader_election.cc:288] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:45.557157 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35c500721e7e40e8a191c3f6849a5b3f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:45.557335 10416 raft_consensus.cc:3037] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.557534 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35c500721e7e40e8a191c3f6849a5b3f" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:45.557725 10282 raft_consensus.cc:3037] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.559974 10416 raft_consensus.cc:2454] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:45.560314 10078 leader_election.cc:302] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:45.560590 11434 raft_consensus.cc:2781] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:45.561058 10282 raft_consensus.cc:2454] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:45.561075 11434 raft_consensus.cc:686] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:45.561679 11434 consensus_queue.cc:237] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.597317 11160 raft_consensus.cc:482] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:45.597509 11160 raft_consensus.cc:504] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.598196 11160 leader_election.cc:288] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:45.598698 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136735419750408da66a0472736a4452" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:45.598783 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136735419750408da66a0472736a4452" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:45.598946 10144 raft_consensus.cc:2454] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:45.599035 10416 raft_consensus.cc:2454] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:45.599431 10217 leader_election.cc:302] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:45.599772 11160 raft_consensus.cc:2781] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:45.599910 11160 raft_consensus.cc:482] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:45.600021 11160 raft_consensus.cc:3037] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.602557 11160 raft_consensus.cc:504] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.603140 11160 leader_election.cc:288] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:45.603663 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136735419750408da66a0472736a4452" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:45.603698 10144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136735419750408da66a0472736a4452" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:45.603895 10416 raft_consensus.cc:3037] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.603883 10144 raft_consensus.cc:3037] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:45.605876 10416 raft_consensus.cc:2454] T 136735419750408da66a0472736a4452 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:45.605983 10144 raft_consensus.cc:2454] T 136735419750408da66a0472736a4452 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:45.606251 10217 leader_election.cc:302] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:45.606556 11160 raft_consensus.cc:2781] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:45.606969 11160 raft_consensus.cc:686] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:45.607421 11160 consensus_queue.cc:237] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:45.690267 11459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:45.690469 11459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:45.691109 11459 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:45.693439 11314 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:45.693650 11314 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:45.693732 11314 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:45.693929 11459 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 04:54:46.086498 9542 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu pid 11297
I20260925 04:54:46.092839 11358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 04:54:46.205698 9542 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu with pid 11297
I20260925 04:54:46.282285 11449 consensus_queue.cc:1035] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.291065 11473 consensus_queue.cc:1035] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.427626 11160 consensus_queue.cc:1035] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.432603 11484 consensus_queue.cc:1035] T 136735419750408da66a0472736a4452 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.495091 11478 consensus_queue.cc:1035] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.501732 11478 consensus_queue.cc:1035] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.539472 11475 consensus_queue.cc:1035] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.546689 11492 consensus_queue.cc:1035] T 563a34c7c5c3448f8f3e391eb105fb84 P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:46.675572 11492 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:46.675801 11492 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:46.676506 11492 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:46.677485 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:46.677670 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:46.677822 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:46.678110 11492 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:46.982625 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--webserver_interface=127.9.81.188
--webserver_port=37703
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 04:54:47.318053 11495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:47.318509 11495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:47.318678 11495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:47.330403 11495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:47.330529 11495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:47.330583 11495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:47.330654 11495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:47.343952 11495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.188:40705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.81.188
--webserver_port=37703
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:47.345273 11495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:47.346959 11495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:47.359411 11509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:47.359517 11508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:47.359990 11511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:47.360262 11495 server_base.cc:1034] running on GCE node
I20260925 04:54:47.361071 11495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:47.362674 11495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:47.363929 11495 hybrid_clock.cc:648] HybridClock initialized: now 1790312087363854 us; error 44 us; skew 500 ppm
I20260925 04:54:47.364248 11495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:47.366415 11495 webserver.cc:460] Webserver started at http://127.9.81.188:37703/ using document root <none> and password file <none>
I20260925 04:54:47.367066 11495 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:47.367210 11495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:47.372025 11495 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:47.374715 11517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:47.375932 11495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260925 04:54:47.376102 11495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
uuid: "39da3a5fade344af9db436d10052b4bc"
format_stamp: "Formatted at 2026-09-25 04:54:27 on dist-test-slave-qkh6"
I20260925 04:54:47.377004 11495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:47.395120 11495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:47.395934 11495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:47.396221 11495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:47.413472 11495 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.188:40705
I20260925 04:54:47.413494 11568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.188:40705 every 8 connection(s)
I20260925 04:54:47.414937 11495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-2/data/info.pb
I20260925 04:54:47.418957 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11495
I20260925 04:54:47.423870 11569 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:47.428908 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap starting.
I20260925 04:54:47.453863 11569 log.cc:824] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:47.480135 10327 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:47.557610 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=143 overwritten=0 applied=143 ignored=0} inserts{seen=82 ignored=0} mutations{seen=138 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 04:54:47.558151 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Bootstrap complete.
I20260925 04:54:47.565734 11569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:47.566617 11569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Initialized, Role: FOLLOWER
I20260925 04:54:47.567225 11569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 143, Last appended: 5.143, Last appended by leader: 143, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:47.568081 11576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:47.568511 11576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:47.569222 11569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:47.584651 11590 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:47.584841 11590 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: loading cluster ID for follower catalog manager: success
I20260925 04:54:47.589777 11590 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: acquiring CA information for follower catalog manager: success
I20260925 04:54:47.593307 11590 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:47.586485 11495 master_runner.cc:186] Error getting master registration for 127.9.81.190:37617: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111),
I20260925 04:54:47.596406 11495 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:47.825459 10189 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:47.828148 11534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:54329; Asking this server to re-register.
I20260925 04:54:47.828840 10189 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:47.830525 11534 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:47.866371 10462 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:47.868790 11534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:33473; Asking this server to re-register.
I20260925 04:54:47.869657 10462 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:47.871539 11534 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:47.984038 10327 heartbeater.cc:347] Connected to a master server at 127.9.81.188:40705
I20260925 04:54:47.985581 11534 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:35107; Asking this server to re-register.
I20260925 04:54:47.986171 10327 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:47.987444 11534 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:48.068351 11576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:48.068590 11576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:48.070439 11576 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:48.071141 11520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:48.072679 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:48.072922 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:48.073097 11520 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:48.073452 11576 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 04:54:48.714092 11604 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:48.714283 11604 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:48.715021 11604 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:48.718034 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:48.718245 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:48.718381 11520 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:48.718636 11604 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 04:54:49.354971 11615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:49.355178 11615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:49.355707 11615 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:49.357821 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:49.358067 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:49.358168 11520 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc; no voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:49.358433 11615 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 04:54:50.450063 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--webserver_interface=127.9.81.189
--webserver_port=36963
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 04:54:50.767771 11630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:50.768029 11630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:50.768179 11630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:50.775594 11630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:50.775683 11630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:50.775753 11630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:50.775862 11630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:50.784623 11630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.81.189
--webserver_port=36963
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:50.785928 11630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:50.787643 11630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:50.801064 11637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:50.801143 11638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:50.801628 11640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:50.801846 11630 server_base.cc:1034] running on GCE node
I20260925 04:54:50.802942 11630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:50.804608 11630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:50.805861 11630 hybrid_clock.cc:648] HybridClock initialized: now 1790312090805782 us; error 49 us; skew 500 ppm
I20260925 04:54:50.806217 11630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:50.812357 11630 webserver.cc:460] Webserver started at http://127.9.81.189:36963/ using document root <none> and password file <none>
I20260925 04:54:50.813199 11630 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:50.813333 11630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:50.819125 11630 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260925 04:54:50.821969 11646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:50.823319 11630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:50.823500 11630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:50.824394 11630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:50.846844 11630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:50.847648 11630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:50.847935 11630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:50.866719 11630 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.189:45475
I20260925 04:54:50.866726 11699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.189:45475 every 8 connection(s)
I20260925 04:54:50.868321 11630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
I20260925 04:54:50.875993 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11630
I20260925 04:54:50.880972 11702 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:50.885821 11702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap starting.
I20260925 04:54:50.887084 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:50.907106 11702 log.cc:824] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:50.908809 11707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:50.909044 11707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:50.909745 11707 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
W20260925 04:54:50.912345 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:50.947523 11499 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:50.947717 11499 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:50.948455 11499 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:50.949303 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:50.949472 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:50.949563 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:50.949769 11499 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:50.994618 10329 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:51.022998 11702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=143 overwritten=0 applied=143 ignored=0} inserts{seen=82 ignored=0} mutations{seen=138 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 04:54:51.023725 11702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap complete.
I20260925 04:54:51.034741 11702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:51.036010 11702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Initialized, Role: FOLLOWER
I20260925 04:54:51.036676 11702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 143, Last appended: 5.143, Last appended by leader: 143, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:51.037704 11713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:51.038129 11713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:51.038707 11702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:51.038800 11675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 143 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc" is_pre_election: true
I20260925 04:54:51.039224 11675 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 5.
I20260925 04:54:51.040024 11520 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5
I20260925 04:54:51.040457 11707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 04:54:51.040594 11707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:51.040683 11707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 5 FOLLOWER]: Advancing to term 6
I20260925 04:54:51.046231 11707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
W20260925 04:54:51.049647 11520 leader_election.cc:334] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:51.054334 11727 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:51.054426 11727 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: success
I20260925 04:54:51.060058 11727 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: acquiring CA information for follower catalog manager: success
I20260925 04:54:51.060895 11675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39da3a5fade344af9db436d10052b4bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 143 } } ignore_live_leader: false dest_uuid: "9c78f840b646474a98deff6bac54d5cc"
I20260925 04:54:51.061136 11675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 5 FOLLOWER]: Advancing to term 6
I20260925 04:54:51.064550 11727 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:51.064821 11707 leader_election.cc:288] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475)
I20260925 04:54:51.050800 11630 master_runner.cc:186] Error getting master registration for 127.9.81.190:37617: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111),
I20260925 04:54:51.065294 11630 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:51.068532 11675 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39da3a5fade344af9db436d10052b4bc in term 6.
I20260925 04:54:51.069043 11520 leader_election.cc:302] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5
I20260925 04:54:51.069561 11707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 6 FOLLOWER]: Leader election won for term 6
I20260925 04:54:51.070772 11707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [term 6 LEADER]: Becoming Leader. State: Replica: 39da3a5fade344af9db436d10052b4bc, State: Running, Role: LEADER
I20260925 04:54:51.071427 11707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 143, Committed index: 143, Last appended: 5.143, Last appended by leader: 143, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:51.076773 11731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 6 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:51.077250 11731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:51.085592 11733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:51.088619 11733 catalog_manager.cc:669] Loaded metadata for table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:51.089143 11733 catalog_manager.cc:669] Loaded metadata for table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:51.089496 11733 catalog_manager.cc:669] Loaded metadata for table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:51.089828 11733 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:51.090157 11733 catalog_manager.cc:669] Loaded metadata for table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:51.090476 11733 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:51.090801 11733 catalog_manager.cc:669] Loaded metadata for table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:51.091167 11733 catalog_manager.cc:669] Loaded metadata for table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:51.093818 11733 tablet_loader.cc:96] loaded metadata for tablet 040e836f705e4023905c863618b8248c (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4])
I20260925 04:54:51.094583 11733 tablet_loader.cc:96] loaded metadata for tablet 136735419750408da66a0472736a4452 (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:51.096132 11733 tablet_loader.cc:96] loaded metadata for tablet 35c500721e7e40e8a191c3f6849a5b3f (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:51.097054 11733 tablet_loader.cc:96] loaded metadata for tablet 4ec88d2656214489b9b14f8517b549ad (table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da])
I20260925 04:54:51.097448 11733 tablet_loader.cc:96] loaded metadata for tablet 563a34c7c5c3448f8f3e391eb105fb84 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:51.098440 11733 tablet_loader.cc:96] loaded metadata for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:51.101725 11733 tablet_loader.cc:96] loaded metadata for tablet d9a959c2af544383a2f2907dc26364e8 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:51.102936 11733 tablet_loader.cc:96] loaded metadata for tablet e82ac233aa63482991098728b93ec1b6 (table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541])
I20260925 04:54:51.104643 11733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:51.106773 11733 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:51.106842 11733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:51.108671 11733 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:51.110289 11733 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Loaded TSK: 0
I20260925 04:54:51.111155 11733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:51.112716 11733 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:51.114507 11733 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 15
I20260925 04:54:51.187798 11534 master_service.cc:946] ReplaceTablet: received request to replace tablet e82ac233aa63482991098728b93ec1b6 from {username='slave'} at 127.0.0.1:57510
I20260925 04:54:51.188927 11530 master_service.cc:946] ReplaceTablet: received request to replace tablet 136735419750408da66a0472736a4452 from {username='slave'} at 127.0.0.1:57510
I20260925 04:54:51.189683 11531 master_service.cc:946] ReplaceTablet: received request to replace tablet 689a7134c47543feaf5c453171ecb75a from {username='slave'} at 127.0.0.1:57510
I20260925 04:54:51.189901 11533 master_service.cc:946] ReplaceTablet: received request to replace tablet 84148597a8b74a0a957c5fc9fd716429 from {username='slave'} at 127.0.0.1:57510
I20260925 04:54:51.189946 11532 master_service.cc:946] ReplaceTablet: received request to replace tablet c49c526a48d34b1d9560ca82c1ec794b from {username='slave'} at 127.0.0.1:57510
I20260925 04:54:51.189514 11529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:51.190725 11529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:51.189134 11527 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:51.191157 11525 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_c4023953be09425f877d1e8a30f45361" } new_table_name: "default.Table_48a023979ead4432a298d53c804329da" modify_external_catalogs: true
I20260925 04:54:51.192809 11532 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:51.193794 11527 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:51.194841 11532 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57510:
table { table_name: "default.Table_dae5fadcd7b441f2b0e36e307fe02b6c" } modify_external_catalogs: true
I20260925 04:54:51.193429 11528 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57510:
name: "default.Table_4a0c924d2d034690b79dd3b5cba5b781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:51.189658 11526 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57510:
name: "default.Table_b32729c82a4b4c558c9a830e172a0c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:51.192878 11531 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57510:
name: "default.Table_273e0dfb03e648e4b9fd3a8abf07a709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:51.195114 11533 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57510:
name: "default.Table_7f50ccca03c042aeb74dd26f1ca15658"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:51.201939 11589 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
W20260925 04:54:51.202374 11589 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:51.203016 11589 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
I20260925 04:54:51.205076 11675 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Refusing update from remote peer 39da3a5fade344af9db436d10052b4bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 143. Preceding OpId from leader: term: 6 index: 145. (index mismatch)
@ 0x7f568bfc39ad google::LogMessage::Fail() at ??:0
@ 0x7f568bfc688a google::LogMessage::SendToLog() at ??:0
W20260925 04:54:51.208597 11520 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc -> Peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Couldn't send request to peer 37499e1d150b41169507d4dd098579b5. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7f568bfc34de google::LogMessage::Flush() at ??:0
@ 0x7f568bfc36d1 google::LogMessage::~LogMessage() at ??:0
I20260925 04:54:51.212610 11731 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 144, Last known committed idx: 143, Time since last communication: 0.000s
@ 0x7f56a1b61ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f56a1b60901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f56a1b6766c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260925 04:54:51.239217 11713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39da3a5fade344af9db436d10052b4bc. Latest consensus state: current_term: 6 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:51.239624 11713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f56a1b674e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260925 04:54:51.244042 11734 mvcc.cc:205] Tried to move back new op lower bound from 7333118325563985920 to 7333118325040275456. Current Snapshot: MvccSnapshot[applied={T|T < 7333118325563985920}]
@ 0x7f568ebedeaf kudu::Thread::SuperviseThread() at ??:0
I20260925 04:54:51.247625 11530 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Sending DeleteTablet for 3 replicas of tablet 136735419750408da66a0472736a4452
I20260925 04:54:51.250111 11530 catalog_manager.cc:6565] ReplaceTablet: tablet 136735419750408da66a0472736a4452 deleted and replaced by tablet d56b51c4a06f4f2c9d54e1dce1afb9ea
I20260925 04:54:51.251760 11534 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39da3a5fade344af9db436d10052b4bc: Sending DeleteTablet for 3 replicas of tablet e82ac233aa63482991098728b93ec1b6
I20260925 04:54:51.252197 11534 catalog_manager.cc:6565] ReplaceTablet: tablet e82ac233aa63482991098728b93ec1b6 deleted and replaced by tablet 73f2344782424660876a7b5f4e4649bd
@ 0x7f5691ec76db start_thread at ??:0
@ 0x7f568ae5d61f clone at ??:0
I20260925 04:54:51.263006 11713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "39da3a5fade344af9db436d10052b4bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:51.263273 11713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:51.342549 10191 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:51.346154 11664 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:41679; Asking this server to re-register.
I20260925 04:54:51.346877 10191 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:51.348959 11664 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:51.390884 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:51.393154 11664 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:37889; Asking this server to re-register.
I20260925 04:54:51.393805 10464 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:51.395385 11664 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
W20260925 04:54:51.461747 11648 connection.cc:535] server connection from 127.0.0.1:35638 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:51.462098 11752 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:51.251845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39068 (local address 127.9.81.131:37105)
0925 04:54:51.260550 (+ 8705us) server_negotiation.cc:206] Beginning negotiation
0925 04:54:51.260555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0925 04:54:51.461763 (+201208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39068: BlockingRecv error: recv got EOF from 127.0.0.1:39068 (error 108)
Metrics: {"server-negotiator.queue_time_us":8598,"thread_start_us":8476,"threads_started":1}
W20260925 04:54:51.462160 11750 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:51.250555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.9.81.129:36933)
0925 04:54:51.259624 (+ 9069us) server_negotiation.cc:206] Beginning negotiation
0925 04:54:51.259633 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0925 04:54:51.259657 (+ 24us) server_negotiation.cc:407] Connection header received
0925 04:54:51.259739 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0925 04:54:51.259747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0925 04:54:51.259852 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0925 04:54:51.259982 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0925 04:54:51.461809 (+201827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53022: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":8910,"thread_start_us":8828,"threads_started":1}
W20260925 04:54:51.462378 10079 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:51.462920 11749 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:51.249520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60866 (local address 127.9.81.130:33869)
0925 04:54:51.255728 (+ 6208us) server_negotiation.cc:206] Beginning negotiation
0925 04:54:51.255735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0925 04:54:51.255755 (+ 20us) server_negotiation.cc:407] Connection header received
0925 04:54:51.255831 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0925 04:54:51.255836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0925 04:54:51.255907 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0925 04:54:51.256010 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0925 04:54:51.257051 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0925 04:54:51.258176 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0925 04:54:51.462588 (+204412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60866: BlockingRecv error: recv got EOF from 127.0.0.1:60866 (error 108)
Metrics: {"server-negotiator.queue_time_us":6067,"thread_start_us":5943,"threads_started":1}
W20260925 04:54:51.463639 10472 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:51.463703 10353 connection.cc:535] client connection to 127.9.81.188:40705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:51.464231 10472 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.188:40705)
W20260925 04:54:51.464969 10472 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:51.465502 10472 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.188:40705)
W20260925 04:54:51.465772 10472 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.188:40705)
I20260925 04:54:51.497881 11664 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:36615; Asking this server to re-register.
I20260925 04:54:51.498486 10329 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:51.499624 11664 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:51.745894 11713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:51.746124 11713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:51.747674 11713 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:51.748747 11650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:51.751051 11650 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:51.751309 11649 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:51.751458 11649 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:51.751760 11713 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:52.381091 11763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:52.381312 11763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:52.381959 11763 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:52.386713 11649 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:52.386914 11650 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:52.387023 11650 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:52.387306 11763 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:53.120472 9542 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu pid 11630
I20260925 04:54:53.121570 11771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39da3a5fade344af9db436d10052b4bc)
I20260925 04:54:53.121923 11771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:53.122818 11771 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:53.124763 11649 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:53.125066 11650 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:53.125190 11650 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:53.125411 11771 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:53.128428 11695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 04:54:53.236943 9542 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu with pid 11630
I20260925 04:54:54.088622 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--webserver_interface=127.9.81.189
--webserver_port=36963
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 04:54:54.415104 11783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:54.415434 11783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:54.415570 11783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:54.422696 11783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:54.422827 11783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:54.422914 11783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:54.423012 11783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:54.431943 11783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.189:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.81.189
--webserver_port=36963
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:54.433262 11783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:54.435148 11783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:54.447492 11789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:54.447564 11790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:54.447978 11792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:54.448449 11783 server_base.cc:1034] running on GCE node
I20260925 04:54:54.449183 11783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:54.450452 11783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:54.451689 11783 hybrid_clock.cc:648] HybridClock initialized: now 1790312094451618 us; error 31 us; skew 500 ppm
I20260925 04:54:54.452070 11783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:54.454223 11783 webserver.cc:460] Webserver started at http://127.9.81.189:36963/ using document root <none> and password file <none>
I20260925 04:54:54.454914 11783 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:54.455058 11783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:54.460031 11783 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.001s
I20260925 04:54:54.462832 11798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:54.464069 11783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260925 04:54:54.464246 11783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
uuid: "9c78f840b646474a98deff6bac54d5cc"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:54.465195 11783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:54.481320 11783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:54.482105 11783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:54.482388 11783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:54.501819 11783 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.189:45475
I20260925 04:54:54.501863 11851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.189:45475 every 8 connection(s)
I20260925 04:54:54.503315 11783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-1/data/info.pb
I20260925 04:54:54.505546 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11783
I20260925 04:54:54.510679 11852 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:54.516450 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap starting.
I20260925 04:54:54.522529 10329 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:54.540231 11852 log.cc:824] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:54.641906 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=146 overwritten=0 applied=146 ignored=0} inserts{seen=84 ignored=0} mutations{seen=140 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 04:54:54.642444 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Bootstrap complete.
I20260925 04:54:54.649890 11852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:54.650746 11852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Initialized, Role: FOLLOWER
I20260925 04:54:54.651422 11852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 146, Last appended: 6.146, Last appended by leader: 146, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:54.652266 11857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:54.652586 11857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:54.653280 11852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:54.665144 11871 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:54.665297 11871 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: loading cluster ID for follower catalog manager: success
I20260925 04:54:54.670972 11871 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: acquiring CA information for follower catalog manager: success
I20260925 04:54:54.675361 11871 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:54.676859 11783 master_runner.cc:186] Error getting master registration for 127.9.81.190:37617: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111),
I20260925 04:54:54.687063 11783 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:54.867169 10191 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:54.869768 11815 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:50083; Asking this server to re-register.
I20260925 04:54:54.870389 10191 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:54.872062 11815 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:54.913081 10464 heartbeater.cc:347] Connected to a master server at 127.9.81.189:45475
I20260925 04:54:54.914624 11815 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:38775; Asking this server to re-register.
I20260925 04:54:54.915251 10464 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:54.916656 11815 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:55.026161 11815 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:41931; Asking this server to re-register.
I20260925 04:54:55.026755 10329 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:55.027972 11815 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:55.152707 11857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:55.152973 11857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:55.155046 11857 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:55.155694 11801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:55.157114 11802 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:55.157720 11801 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
I20260925 04:54:55.157879 11801 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:55.158150 11857 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:55.766394 11882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:55.766608 11882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:55.767331 11882 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:55.769433 11801 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:55.769924 11802 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:55.770092 11802 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:55.770349 11882 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:56.637068 11890 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:56.637246 11890 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:56.638005 11890 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:56.640067 11801 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617): Network error: Client connection negotiation failed: client connection to 127.9.81.190:37617: connect: Connection refused (error 111)
W20260925 04:54:56.640242 11802 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:56.640395 11802 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c78f840b646474a98deff6bac54d5cc; no voters: 37499e1d150b41169507d4dd098579b5, 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:56.640641 11890 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 04:54:57.288561 11879 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:57.288792 11879 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:54:57.289494 11879 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:54:57.290362 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:54:57.290519 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:54:57.290656 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:54:57.290927 11879 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:57.404798 9542 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
/tmp/dist-test-taskn1Fdef/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--webserver_interface=127.9.81.190
--webserver_port=33381
--builtin_ntp_servers=127.9.81.148:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 04:54:57.724977 11898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 04:54:57.725358 11898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 04:54:57.725498 11898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 04:54:57.732515 11898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 04:54:57.732641 11898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 04:54:57.732738 11898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 04:54:57.732839 11898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 04:54:57.742089 11898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.81.148:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:37197
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.81.190:37617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.81.190
--webserver_port=33381
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 25 Sep 2026 04:03:47 UTC on ccycloud.quasar-nljujk.root.comops.site
build id 4671827
ASAN enabled
I20260925 04:54:57.743372 11898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 04:54:57.745088 11898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 04:54:57.757138 11905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:57.757114 11908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 04:54:57.757082 11906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 04:54:57.758340 11898 server_base.cc:1034] running on GCE node
I20260925 04:54:57.759119 11898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 04:54:57.760380 11898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 04:54:57.761665 11898 hybrid_clock.cc:648] HybridClock initialized: now 1790312097761569 us; error 46 us; skew 500 ppm
I20260925 04:54:57.762207 11898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 04:54:57.767884 11898 webserver.cc:460] Webserver started at http://127.9.81.190:33381/ using document root <none> and password file <none>
I20260925 04:54:57.768550 11898 fs_manager.cc:359] Metadata directory not provided
I20260925 04:54:57.768713 11898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 04:54:57.773679 11898 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260925 04:54:57.776297 11914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 04:54:57.777577 11898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260925 04:54:57.777743 11898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data,/tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
uuid: "37499e1d150b41169507d4dd098579b5"
format_stamp: "Formatted at 2026-09-25 04:54:26 on dist-test-slave-qkh6"
I20260925 04:54:57.778646 11898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 04:54:57.791633 11898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 04:54:57.792397 11898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 04:54:57.792685 11898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 04:54:57.815738 11898 rpc_server.cc:307] RPC server started. Bound to: 127.9.81.190:37617
I20260925 04:54:57.815771 11965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.81.190:37617 every 8 connection(s)
I20260925 04:54:57.817210 11898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/master-0/data/info.pb
I20260925 04:54:57.823276 9542 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskn1Fdef/build/asan/bin/kudu as pid 11898
I20260925 04:54:57.823323 11966 sys_catalog.cc:263] Verifying existing consensus state
I20260925 04:54:57.827370 11966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap starting.
I20260925 04:54:57.845237 11966 log.cc:824] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Log is configured to *not* fsync() on all Append() calls
I20260925 04:54:57.858143 10190 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:57.858348 10190 heartbeater.cc:503] Master 127.9.81.190:37617 was elected leader, sending a full tablet report...
I20260925 04:54:57.892549 10463 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:57.944119 11966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=140 overwritten=0 applied=138 ignored=0} inserts{seen=80 ignored=0} mutations{seen=132 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260925 04:54:57.944775 11966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: Bootstrap complete.
I20260925 04:54:57.952399 11966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:57.955524 11966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37499e1d150b41169507d4dd098579b5, State: Initialized, Role: FOLLOWER
I20260925 04:54:57.956228 11966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 138, Last appended: 4.140, Last appended by leader: 140, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:57.956969 11971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:57.957331 11971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:57.958010 11966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 04:54:57.963693 11985 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260925 04:54:57.984754 11898 master_runner.cc:186] Error getting master registration for 127.9.81.188:40705: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111),
I20260925 04:54:57.990252 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:54:58.015453 10328 heartbeater.cc:347] Connected to a master server at 127.9.81.190:37617
I20260925 04:54:58.018141 11931 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" instance_seqno: 1790312068777440) as {username='slave'} at 127.9.81.130:38823; Asking this server to re-register.
I20260925 04:54:58.018783 10328 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:58.020252 11931 ts_manager.cc:194] Registered new tserver with Master: d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:58.323300 11993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:58.323541 11993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:58.324302 11993 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:58.327376 11802 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:58.331825 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 7 candidate_status { last_received { term: 6 index: 146 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5" is_pre_election: true
I20260925 04:54:58.332343 11941 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 4.
I20260925 04:54:58.332896 11801 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:58.333214 11993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 04:54:58.333319 11993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:58.333398 11993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 6 FOLLOWER]: Advancing to term 7
I20260925 04:54:58.337143 11993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:58.337644 11993 leader_election.cc:288] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 election: Requested vote from peers 37499e1d150b41169507d4dd098579b5 (127.9.81.190:37617), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
I20260925 04:54:58.338155 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c78f840b646474a98deff6bac54d5cc" candidate_term: 7 candidate_status { last_received { term: 6 index: 146 } } ignore_live_leader: false dest_uuid: "37499e1d150b41169507d4dd098579b5"
I20260925 04:54:58.338382 11941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 4 FOLLOWER]: Advancing to term 7
W20260925 04:54:58.339047 11802 leader_election.cc:334] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:58.341950 11941 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c78f840b646474a98deff6bac54d5cc in term 7.
I20260925 04:54:58.342365 11801 leader_election.cc:302] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37499e1d150b41169507d4dd098579b5, 9c78f840b646474a98deff6bac54d5cc; no voters: 39da3a5fade344af9db436d10052b4bc
I20260925 04:54:58.342645 11993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 7 FOLLOWER]: Leader election won for term 7
I20260925 04:54:58.343099 11993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [term 7 LEADER]: Becoming Leader. State: Replica: 9c78f840b646474a98deff6bac54d5cc, State: Running, Role: LEADER
I20260925 04:54:58.343546 11993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 146, Committed index: 146, Last appended: 6.146, Last appended by leader: 146, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:58.346254 11997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.346608 11997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:58.347236 11999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 04:54:58.350211 11999 catalog_manager.cc:669] Loaded metadata for table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da]
I20260925 04:54:58.350605 11999 catalog_manager.cc:669] Loaded metadata for table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]
I20260925 04:54:58.350898 11999 catalog_manager.cc:669] Loaded metadata for table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]
I20260925 04:54:58.351162 11999 catalog_manager.cc:669] Loaded metadata for table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c]
I20260925 04:54:58.351423 11999 catalog_manager.cc:669] Loaded metadata for table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]
I20260925 04:54:58.351858 11999 catalog_manager.cc:669] Loaded metadata for table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]
I20260925 04:54:58.352123 11999 catalog_manager.cc:669] Loaded metadata for table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4]
I20260925 04:54:58.352394 11999 catalog_manager.cc:669] Loaded metadata for table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748]
I20260925 04:54:58.354777 11999 tablet_loader.cc:96] loaded metadata for tablet 040e836f705e4023905c863618b8248c (table default.table_95c110b2e1554ef3a459f6eca6e29381 [id=d3997af115df4887b7dc5d9474fbdfb4])
I20260925 04:54:58.357208 11999 tablet_loader.cc:96] loaded metadata for tablet 35c500721e7e40e8a191c3f6849a5b3f (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04])
I20260925 04:54:58.358070 11999 tablet_loader.cc:96] loaded metadata for tablet 4ec88d2656214489b9b14f8517b549ad (table default.table_dae5fadcd7b441f2b0e36e307fe02b6c [id=2728e9bf5ed64a0d90695b9d2e7e52da])
I20260925 04:54:58.358505 11999 tablet_loader.cc:96] loaded metadata for tablet 563a34c7c5c3448f8f3e391eb105fb84 (table default.table_6c52826d192a4ccda763b30ee29815ad [id=dc9e5e373e9b4b59ab8b8a9a22f76748])
I20260925 04:54:58.359306 11999 tablet_loader.cc:96] loaded metadata for tablet 73f2344782424660876a7b5f4e4649bd (table default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541])
I20260925 04:54:58.359658 11999 tablet_loader.cc:96] loaded metadata for tablet 7ec2296f1d414013bb2699ed9fd7d2fc (table default.table_7c18ad193ee94ec4b84052d29519acd5 [id=40d7af037b5240979abcbea6569b5e7c])
I20260925 04:54:58.362015 11999 tablet_loader.cc:96] loaded metadata for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea (table default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f])
I20260925 04:54:58.362323 11999 tablet_loader.cc:96] loaded metadata for tablet d9a959c2af544383a2f2907dc26364e8 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166])
I20260925 04:54:58.365499 10190 heartbeater.cc:503] Master 127.9.81.190:37617 was elected leader, sending a full tablet report...
I20260925 04:54:58.365592 11999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 04:54:58.367746 11999 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:58.367812 11999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 04:54:58.367904 11931 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "270ea27d66a1425eae85f73563e04c00" instance_seqno: 1790312068274129) as {username='slave'} at 127.9.81.129:56007; Asking this server to re-register.
I20260925 04:54:58.368611 10190 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:58.370038 11931 ts_manager.cc:194] Registered new tserver with Master: 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933)
I20260925 04:54:58.370277 11999 catalog_manager.cc:1504] Loading token signing keys...
I20260925 04:54:58.371907 11999 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Loaded TSK: 0
I20260925 04:54:58.372691 11999 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 04:54:58.374287 11999 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260925 04:54:58.375800 11999 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 15
I20260925 04:54:58.396368 11931 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "604491977af14bc2b62f45a594c13bf9" instance_seqno: 1790312069249981) as {username='slave'} at 127.9.81.131:47703; Asking this server to re-register.
I20260925 04:54:58.396966 10463 heartbeater.cc:464] Registering TS with master...
I20260925 04:54:58.398187 11931 ts_manager.cc:194] Registered new tserver with Master: 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:58.451426 11815 master_service.cc:946] ReplaceTablet: received request to replace tablet 35c500721e7e40e8a191c3f6849a5b3f from {username='slave'} at 127.0.0.1:47570
I20260925 04:54:58.451524 11814 master_service.cc:946] ReplaceTablet: received request to replace tablet d9a959c2af544383a2f2907dc26364e8 from {username='slave'} at 127.0.0.1:47570
I20260925 04:54:58.452100 11811 master_service.cc:946] ReplaceTablet: received request to replace tablet e82ac233aa63482991098728b93ec1b6 from {username='slave'} at 127.0.0.1:47570
I20260925 04:54:58.453162 11807 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:58.454305 11813 master_service.cc:946] ReplaceTablet: received request to replace tablet 590c902ec8ea41679146d82b058e01e3 from {username='slave'} at 127.0.0.1:47570
I20260925 04:54:58.455137 11813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:58.455247 11811 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_046291a687f44532af93aec0cf2df2c4" } new_table_name: "default.Table_1a741086c07f44e88bab2ccc1735fd67" modify_external_catalogs: true
I20260925 04:54:58.455499 11813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_6c52826d192a4ccda763b30ee29815ad" } modify_external_catalogs: true
I20260925 04:54:58.455814 11812 master_service.cc:946] ReplaceTablet: received request to replace tablet 590c902ec8ea41679146d82b058e01e3 from {username='slave'} at 127.0.0.1:47570
I20260925 04:54:58.456396 11812 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:58.456609 11812 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_95c110b2e1554ef3a459f6eca6e29381" } modify_external_catalogs: true
I20260925 04:54:58.457072 11810 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "default.Table_80d05ca86f934088be48a6989b971ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:58.457720 11809 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "default.Table_1d5987cf0ad94f428a8c5ad200753709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:58.458396 11808 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "default.Table_9a7f064f807444c69ef2ae958de42e7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:58.459038 11806 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_421a98a632c24f8296c302eef981e44f" } new_table_name: "default.Table_082709c0f7b0469a83d4fb0e9002f8a5" modify_external_catalogs: true
I20260925 04:54:58.464442 11941 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Refusing update from remote peer 9c78f840b646474a98deff6bac54d5cc: Log matching property violated. Preceding OpId in replica: term: 4 index: 140. Preceding OpId from leader: term: 7 index: 148. (index mismatch)
W20260925 04:54:58.465620 11802 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc -> Peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Couldn't send request to peer 39da3a5fade344af9db436d10052b4bc. Status: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 04:54:58.465853 11997 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 147, Last known committed idx: 138, Time since last communication: 0.000s
I20260925 04:54:58.467263 11870 catalog_manager.cc:2709] Deleting table default.table_80d05ca86f934088be48a6989b971ac4 [id=b224d52b3fcf402392e92c06fab50ac9] in response to Hive Metastore notification log event 16
W20260925 04:54:58.467705 11870 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 16 DROP_TABLE default.table_80d05ca86f934088be48a6989b971ac4: Not found: the table does not exist: table_id: "b224d52b3fcf402392e92c06fab50ac9" table_name: "default.table_80d05ca86f934088be48a6989b971ac4"
F20260925 04:54:58.467832 11870 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 16): 16 CREATE_TABLE default.table_dae5fadcd7b441f2b0e36e307fe02b6c
*** Check failure stack trace: ***
@ 0x7f04929b09ad google::LogMessage::Fail() at ??:0
@ 0x7f04929b388a google::LogMessage::SendToLog() at ??:0
@ 0x7f04929b04de google::LogMessage::Flush() at ??:0
@ 0x7f04929b06d1 google::LogMessage::~LogMessage() at ??:0
I20260925 04:54:58.477227 12007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.477541 12007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:58.477654 12002 mvcc.cc:205] Tried to move back new op lower bound from 7333118325569228800 to 7333118298357317632. Current Snapshot: MvccSnapshot[applied={T|T < 7333118325563985920}]
I20260925 04:54:58.478101 12001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c78f840b646474a98deff6bac54d5cc. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.478449 12001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:58.478698 12008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.479013 12008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:58.477193 12004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.480144 12004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:58.485234 12000 mvcc.cc:205] Tried to move back new op lower bound from 7333118355297955840 to 7333118354818691072. Current Snapshot: MvccSnapshot[applied={T|T < 7333118355297955840}]
@ 0x7f04a854eba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260925 04:54:58.489782 12004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.490046 12004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 04:54:58.491698 11814 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet d9a959c2af544383a2f2907dc26364e8
I20260925 04:54:58.492111 11815 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc: Sending DeleteTablet for 3 replicas of tablet 35c500721e7e40e8a191c3f6849a5b3f
I20260925 04:54:58.493908 11815 catalog_manager.cc:6565] ReplaceTablet: tablet 35c500721e7e40e8a191c3f6849a5b3f deleted and replaced by tablet 8550736cdc014441a3219ea1e3391145
I20260925 04:54:58.494966 11814 catalog_manager.cc:6565] ReplaceTablet: tablet d9a959c2af544383a2f2907dc26364e8 deleted and replaced by tablet 57deb2c5e31d410e82ad12948dbc0da3
@ 0x7f04a854d901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260925 04:54:58.505324 11814 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:58.505565 11814 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47570:
table { table_name: "default.Table_0b95ecb5a1304fb2a638058d060a2d1e" } modify_external_catalogs: true
I20260925 04:54:58.506103 11815 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "default.Table_4a0c924d2d034690b79dd3b5cba5b781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 04:54:58.508833 10121 tablet_service.cc:1514] Processing DeleteTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 8550736cdc014441a3219ea1e3391145) from {username='slave'} at 127.0.0.1:45974
I20260925 04:54:58.508960 10124 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a959c2af544383a2f2907dc26364e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57deb2c5e31d410e82ad12948dbc0da3) from {username='slave'} at 127.0.0.1:45974
I20260925 04:54:58.513188 11993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "9c78f840b646474a98deff6bac54d5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } } }
I20260925 04:54:58.513571 11993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c78f840b646474a98deff6bac54d5cc [sys.catalog]: This master's current role is: LEADER
I20260925 04:54:58.519731 10124 tablet_service.cc:1467] Processing CreateTablet for tablet 57deb2c5e31d410e82ad12948dbc0da3 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.520182 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57deb2c5e31d410e82ad12948dbc0da3. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f04a855466c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260925 04:54:58.526262 10262 tablet_service.cc:1467] Processing CreateTablet for tablet 57deb2c5e31d410e82ad12948dbc0da3 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.526430 10259 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a959c2af544383a2f2907dc26364e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57deb2c5e31d410e82ad12948dbc0da3) from {username='slave'} at 127.0.0.1:40258
I20260925 04:54:58.526762 10262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57deb2c5e31d410e82ad12948dbc0da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.526858 10258 tablet_service.cc:1514] Processing DeleteTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 8550736cdc014441a3219ea1e3391145) from {username='slave'} at 127.0.0.1:40258
I20260925 04:54:58.527411 10257 tablet_service.cc:1467] Processing CreateTablet for tablet 8550736cdc014441a3219ea1e3391145 (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.527856 10257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8550736cdc014441a3219ea1e3391145. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f04a85544e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260925 04:54:58.532435 10260 tablet_service.cc:1467] Processing CreateTablet for tablet 73f2344782424660876a7b5f4e4649bd (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.532932 10260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f2344782424660876a7b5f4e4649bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.533761 12020 tablet_replica.cc:330] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:58.533991 12020 raft_consensus.cc:2229] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:58.534065 10122 tablet_service.cc:1467] Processing CreateTablet for tablet 73f2344782424660876a7b5f4e4649bd (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.534358 12020 raft_consensus.cc:2258] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.534493 10122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f2344782424660876a7b5f4e4649bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.534970 12020 ts_tablet_manager.cc:1905] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.535111 12023 tablet_replica.cc:330] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:58.535298 12023 raft_consensus.cc:2229] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:58.535532 12023 raft_consensus.cc:2258] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.536046 12023 ts_tablet_manager.cc:1905] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.537308 10261 tablet_service.cc:1467] Processing CreateTablet for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.537637 10261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.542042 12024 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:58.542034 10120 tablet_service.cc:1467] Processing CreateTablet for tablet 8550736cdc014441a3219ea1e3391145 (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.542404 10120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8550736cdc014441a3219ea1e3391145. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f04955daeaf kudu::Thread::SuperviseThread() at ??:0
I20260925 04:54:58.543957 12024 tablet_bootstrap.cc:654] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
@ 0x7f04988b46db start_thread at ??:0
I20260925 04:54:58.546974 12020 ts_tablet_manager.cc:1918] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.547094 12020 log.cc:1196] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/35c500721e7e40e8a191c3f6849a5b3f
I20260925 04:54:58.547565 12020 ts_tablet_manager.cc:1939] T 35c500721e7e40e8a191c3f6849a5b3f P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:58.548396 12020 tablet_replica.cc:330] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: stopping tablet replica
I20260925 04:54:58.548579 12020 raft_consensus.cc:2229] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:58.548717 12020 raft_consensus.cc:2258] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.548687 11802 catalog_manager.cc:4841] TS 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): tablet 35c500721e7e40e8a191c3f6849a5b3f (table default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]) successfully deleted
I20260925 04:54:58.549256 12020 ts_tablet_manager.cc:1905] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.551759 12023 ts_tablet_manager.cc:1918] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.551896 12023 log.cc:1196] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/d9a959c2af544383a2f2907dc26364e8
I20260925 04:54:58.552358 12023 ts_tablet_manager.cc:1939] T d9a959c2af544383a2f2907dc26364e8 P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:58.553355 11800 catalog_manager.cc:4841] TS d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): tablet d9a959c2af544383a2f2907dc26364e8 (table default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]) successfully deleted
@ 0x7f049184a61f clone at ??:0
I20260925 04:54:58.554862 10394 tablet_service.cc:1514] Processing DeleteTablet for tablet 35c500721e7e40e8a191c3f6849a5b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 8550736cdc014441a3219ea1e3391145) from {username='slave'} at 127.0.0.1:36010
I20260925 04:54:58.555262 10393 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a959c2af544383a2f2907dc26364e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57deb2c5e31d410e82ad12948dbc0da3) from {username='slave'} at 127.0.0.1:36010
I20260925 04:54:58.555233 10392 tablet_service.cc:1467] Processing CreateTablet for tablet 8550736cdc014441a3219ea1e3391145 (DEFAULT_TABLE table=default.table_48a023979ead4432a298d53c804329da [id=7911f32186554f5784504181f296bb04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.555444 12020 ts_tablet_manager.cc:1918] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.555517 12024 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:58.555569 12020 log.cc:1196] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-0/wal/wals/d9a959c2af544383a2f2907dc26364e8
I20260925 04:54:58.555636 12024 ts_tablet_manager.cc:1397] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260925 04:54:58.555717 10392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8550736cdc014441a3219ea1e3391145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.555675 10396 tablet_service.cc:1467] Processing CreateTablet for tablet 57deb2c5e31d410e82ad12948dbc0da3 (DEFAULT_TABLE table=default.table_0b95ecb5a1304fb2a638058d060a2d1e [id=2bd7c20230304177a82b16cbf5be9166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.555982 12020 ts_tablet_manager.cc:1939] T d9a959c2af544383a2f2907dc26364e8 P 270ea27d66a1425eae85f73563e04c00: Deleting consensus metadata
I20260925 04:54:58.556056 10396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57deb2c5e31d410e82ad12948dbc0da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.556373 10397 tablet_service.cc:1467] Processing CreateTablet for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.556447 12024 raft_consensus.cc:348] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.556684 12024 raft_consensus.cc:374] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.556749 10397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.556759 12024 raft_consensus.cc:729] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.557017 12024 consensus_queue.cc:260] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.558377 12024 ts_tablet_manager.cc:1428] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:58.558647 12024 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:58.559619 12028 tablet_replica.cc:330] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:58.559813 12028 raft_consensus.cc:2229] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:58.560252 10395 tablet_service.cc:1467] Processing CreateTablet for tablet 73f2344782424660876a7b5f4e4649bd (DEFAULT_TABLE table=default.table_97aab5f07e904b7580396563fdcec71e [id=36cf0a3eb109407793198deb18b02541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.560616 10395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73f2344782424660876a7b5f4e4649bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.561311 12028 raft_consensus.cc:2258] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.563041 12024 tablet_bootstrap.cc:654] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.563903 12028 ts_tablet_manager.cc:1905] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.569149 12023 tablet_replica.cc:330] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: stopping tablet replica
I20260925 04:54:58.569361 12023 raft_consensus.cc:2229] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 04:54:58.569548 12023 raft_consensus.cc:2258] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.570160 12023 ts_tablet_manager.cc:1905] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.573614 12024 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:58.573757 12024 ts_tablet_manager.cc:1397] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260925 04:54:58.574470 12024 raft_consensus.cc:348] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.574689 12024 raft_consensus.cc:374] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.574757 12024 raft_consensus.cc:729] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.575039 12024 consensus_queue.cc:260] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.575486 12025 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:58.576231 12024 ts_tablet_manager.cc:1428] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 04:54:58.576488 12024 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:58.577798 12025 tablet_bootstrap.cc:654] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.579489 10121 tablet_service.cc:1467] Processing CreateTablet for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea (DEFAULT_TABLE table=default.table_8e8ca768548d4f2887c17d8046fe4c32 [id=a03fe4cdf19a4c4492d54c58df4aec7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 04:54:58.579960 10121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d56b51c4a06f4f2c9d54e1dce1afb9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 04:54:58.580241 12024 tablet_bootstrap.cc:654] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.587013 12028 ts_tablet_manager.cc:1918] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.587177 12028 log.cc:1196] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/35c500721e7e40e8a191c3f6849a5b3f
I20260925 04:54:58.587631 12028 ts_tablet_manager.cc:1939] T 35c500721e7e40e8a191c3f6849a5b3f P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:58.588871 12025 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:58.589018 12024 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:58.589022 12025 ts_tablet_manager.cc:1397] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260925 04:54:58.589180 12024 ts_tablet_manager.cc:1397] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260925 04:54:58.589794 12025 raft_consensus.cc:348] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.590040 12025 raft_consensus.cc:374] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.589903 12024 raft_consensus.cc:348] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.590114 12025 raft_consensus.cc:729] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.590161 12024 raft_consensus.cc:374] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.590253 12024 raft_consensus.cc:729] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.590342 12025 consensus_queue.cc:260] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.590835 10191 heartbeater.cc:503] Master 127.9.81.189:45475 was elected leader, sending a full tablet report...
I20260925 04:54:58.590906 12023 ts_tablet_manager.cc:1918] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.591063 12023 log.cc:1196] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-1/wal/wals/35c500721e7e40e8a191c3f6849a5b3f
I20260925 04:54:58.590518 12024 consensus_queue.cc:260] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.591938 12023 ts_tablet_manager.cc:1939] T 35c500721e7e40e8a191c3f6849a5b3f P d3c81f5b22cd4de9b25c02fd05b536b4: Deleting consensus metadata
I20260925 04:54:58.592737 12029 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:58.593292 12025 ts_tablet_manager.cc:1428] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260925 04:54:58.594488 12025 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:58.594583 12029 tablet_bootstrap.cc:654] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.596792 12025 tablet_bootstrap.cc:654] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.598405 12024 ts_tablet_manager.cc:1428] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260925 04:54:58.601734 12024 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4: Bootstrap starting.
I20260925 04:54:58.602042 11600 raft_consensus.cc:482] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:58.602195 11600 raft_consensus.cc:504] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.603061 11600 leader_election.cc:288] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:58.603832 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:58.604097 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
W20260925 04:54:58.604756 10217 leader_election.cc:341] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105): Illegal state: must be running to vote when last-logged opid is not known
W20260925 04:54:58.605017 10218 leader_election.cc:341] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Illegal state: must be running to vote when last-logged opid is not known
I20260925 04:54:58.605135 10218 leader_election.cc:302] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3c81f5b22cd4de9b25c02fd05b536b4; no voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9
I20260925 04:54:58.605160 12028 tablet_replica.cc:330] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: stopping tablet replica
I20260925 04:54:58.605446 12028 raft_consensus.cc:2229] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 04:54:58.605461 11600 raft_consensus.cc:2726] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:54:58.605796 12028 raft_consensus.cc:2258] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 04:54:58.606434 12028 ts_tablet_manager.cc:1905] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 04:54:58.606557 12029 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:58.606673 12029 ts_tablet_manager.cc:1397] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.012s
I20260925 04:54:58.607007 12024 tablet_bootstrap.cc:654] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.607476 12029 raft_consensus.cc:348] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.607743 12029 raft_consensus.cc:374] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.607851 12029 raft_consensus.cc:729] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.608111 12029 consensus_queue.cc:260] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.608604 10464 heartbeater.cc:503] Master 127.9.81.189:45475 was elected leader, sending a full tablet report...
I20260925 04:54:58.609905 12029 ts_tablet_manager.cc:1428] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 04:54:58.611160 12029 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:58.612735 12029 tablet_bootstrap.cc:654] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.612982 12028 ts_tablet_manager.cc:1918] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 04:54:58.613147 12028 log.cc:1196] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Deleting WAL directory at /tmp/dist-test-taskn1Fdef/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1790312052726457-9542-0/minicluster-data/ts-2/wal/wals/d9a959c2af544383a2f2907dc26364e8
I20260925 04:54:58.613600 12028 ts_tablet_manager.cc:1939] T d9a959c2af544383a2f2907dc26364e8 P 604491977af14bc2b62f45a594c13bf9: Deleting consensus metadata
I20260925 04:54:58.615653 12024 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4: No bootstrap required, opened a new log
I20260925 04:54:58.615653 12025 tablet_bootstrap.cc:492] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:58.615806 12024 ts_tablet_manager.cc:1397] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260925 04:54:58.615806 12025 ts_tablet_manager.cc:1397] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.006s
I20260925 04:54:58.616505 12025 raft_consensus.cc:348] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.616504 12024 raft_consensus.cc:348] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.616731 12025 raft_consensus.cc:374] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.616739 12024 raft_consensus.cc:374] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.616806 12024 raft_consensus.cc:729] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.616809 12025 raft_consensus.cc:729] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.617086 12024 consensus_queue.cc:260] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.617092 12025 consensus_queue.cc:260] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.617636 12024 ts_tablet_manager.cc:1428] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:58.618602 12025 ts_tablet_manager.cc:1428] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:58.618877 12025 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:58.619921 12029 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:58.620059 12029 ts_tablet_manager.cc:1397] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260925 04:54:58.620393 12025 tablet_bootstrap.cc:654] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.620826 12029 raft_consensus.cc:348] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.621098 12029 raft_consensus.cc:374] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.621178 12029 raft_consensus.cc:729] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.621505 12029 consensus_queue.cc:260] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.623551 12029 ts_tablet_manager.cc:1428] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 04:54:58.624869 12029 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:58.626999 12029 tablet_bootstrap.cc:654] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.630096 12029 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:58.630115 12025 tablet_bootstrap.cc:492] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:58.630192 12029 ts_tablet_manager.cc:1397] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260925 04:54:58.630244 12025 ts_tablet_manager.cc:1397] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.007s
I20260925 04:54:58.630669 12029 raft_consensus.cc:348] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.630816 12029 raft_consensus.cc:374] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.630883 12029 raft_consensus.cc:729] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.630921 12025 raft_consensus.cc:348] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.631160 12025 raft_consensus.cc:374] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.631243 12025 raft_consensus.cc:729] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.631103 12029 consensus_queue.cc:260] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.631457 12025 consensus_queue.cc:260] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.631995 12025 ts_tablet_manager.cc:1428] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 04:54:58.634744 12029 ts_tablet_manager.cc:1428] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 04:54:58.636571 12029 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9: Bootstrap starting.
I20260925 04:54:58.638247 12025 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00: Bootstrap starting.
I20260925 04:54:58.638604 12029 tablet_bootstrap.cc:654] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.640652 12025 tablet_bootstrap.cc:654] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00: Neither blocks nor log segments found. Creating new log.
I20260925 04:54:58.646636 12029 tablet_bootstrap.cc:492] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9: No bootstrap required, opened a new log
I20260925 04:54:58.646801 12029 ts_tablet_manager.cc:1397] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260925 04:54:58.647660 12029 raft_consensus.cc:348] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.647943 12029 raft_consensus.cc:374] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.648022 12029 raft_consensus.cc:729] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.648324 12029 consensus_queue.cc:260] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.652704 12029 ts_tablet_manager.cc:1428] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 04:54:58.657289 12025 tablet_bootstrap.cc:492] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00: No bootstrap required, opened a new log
I20260925 04:54:58.657478 12025 ts_tablet_manager.cc:1397] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20260925 04:54:58.658282 12025 raft_consensus.cc:348] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.658524 12025 raft_consensus.cc:374] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 04:54:58.658605 12025 raft_consensus.cc:729] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Initialized, Role: FOLLOWER
I20260925 04:54:58.658833 12025 consensus_queue.cc:260] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.659968 12025 ts_tablet_manager.cc:1428] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 04:54:58.697733 11991 raft_consensus.cc:482] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:58.697959 11991 raft_consensus.cc:504] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.698627 11991 leader_election.cc:288] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:58.699261 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d56b51c4a06f4f2c9d54e1dce1afb9ea" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:58.699548 10143 raft_consensus.cc:2454] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:58.699949 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d56b51c4a06f4f2c9d54e1dce1afb9ea" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:58.700178 10282 raft_consensus.cc:2454] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:58.700683 10351 leader_election.cc:302] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:58.701174 11991 raft_consensus.cc:2781] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:58.701287 11991 raft_consensus.cc:482] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:58.701365 11991 raft_consensus.cc:3037] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.704413 11991 raft_consensus.cc:504] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.705080 11991 leader_election.cc:288] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:58.705488 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d56b51c4a06f4f2c9d54e1dce1afb9ea" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:58.705513 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d56b51c4a06f4f2c9d54e1dce1afb9ea" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:58.705716 10143 raft_consensus.cc:3037] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.705722 10282 raft_consensus.cc:3037] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.707571 10143 raft_consensus.cc:2454] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:58.707979 10353 leader_election.cc:302] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:58.708237 11991 raft_consensus.cc:2781] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:58.708559 10282 raft_consensus.cc:2454] T d56b51c4a06f4f2c9d54e1dce1afb9ea P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:58.708724 11991 raft_consensus.cc:686] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:58.709177 11991 consensus_queue.cc:237] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.757201 11600 raft_consensus.cc:482] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:58.757398 11600 raft_consensus.cc:504] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.758167 11600 leader_election.cc:288] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:58.758728 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8550736cdc014441a3219ea1e3391145" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:58.758786 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8550736cdc014441a3219ea1e3391145" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:58.759006 10416 raft_consensus.cc:2454] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:58.758994 10143 raft_consensus.cc:2454] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 0.
I20260925 04:54:58.759424 10217 leader_election.cc:302] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:58.759701 11600 raft_consensus.cc:2781] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:58.759847 11600 raft_consensus.cc:482] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:58.759953 11600 raft_consensus.cc:3037] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.763139 11600 raft_consensus.cc:504] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.763774 11600 leader_election.cc:288] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:58.764240 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8550736cdc014441a3219ea1e3391145" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:58.764418 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8550736cdc014441a3219ea1e3391145" candidate_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:58.764465 10416 raft_consensus.cc:3037] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.764566 10143 raft_consensus.cc:3037] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.766534 10143 raft_consensus.cc:2454] T 8550736cdc014441a3219ea1e3391145 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:58.766870 10218 leader_election.cc:302] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:58.767139 11600 raft_consensus.cc:2781] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:58.767587 11600 raft_consensus.cc:686] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 LEADER]: Becoming Leader. State: Replica: d3c81f5b22cd4de9b25c02fd05b536b4, State: Running, Role: LEADER
I20260925 04:54:58.767586 10416 raft_consensus.cc:2454] T 8550736cdc014441a3219ea1e3391145 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3c81f5b22cd4de9b25c02fd05b536b4 in term 1.
I20260925 04:54:58.768600 11600 consensus_queue.cc:237] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
W20260925 04:54:58.785398 10217 connection.cc:535] server connection from 127.0.0.1:40258 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.785398 10352 connection.cc:535] server connection from 127.0.0.1:36010 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.785410 10078 connection.cc:535] server connection from 127.0.0.1:45974 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.786000 10352 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.786293 10471 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.786908 10078 connection.cc:535] client connection to 127.9.81.189:45475 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 04:54:58.786959 10471 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.81.189:45475)
W20260925 04:54:58.787642 10471 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:58.787851 11989 negotiation.cc:337] Failed RPC negotiation. Trace:
0925 04:54:58.786489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.81.189:45475 (local address 127.9.81.130:46935)
0925 04:54:58.786762 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0925 04:54:58.786782 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0925 04:54:58.786896 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0925 04:54:58.787609 (+ 713us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":143}
W20260925 04:54:58.787895 10471 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.81.189:45475)
W20260925 04:54:58.788558 10471 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.81.189:45475)
I20260925 04:54:58.901863 11991 raft_consensus.cc:482] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:58.902127 11991 raft_consensus.cc:504] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.902805 11991 leader_election.cc:288] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:58.903220 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f2344782424660876a7b5f4e4649bd" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00" is_pre_election: true
I20260925 04:54:58.903524 10143 raft_consensus.cc:2454] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:58.903455 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f2344782424660876a7b5f4e4649bd" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:58.903730 10282 raft_consensus.cc:2454] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 0.
I20260925 04:54:58.903924 10353 leader_election.cc:302] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9; no voters:
I20260925 04:54:58.904248 11991 raft_consensus.cc:2781] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:58.904357 11991 raft_consensus.cc:482] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:58.904465 11991 raft_consensus.cc:3037] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.906385 11991 raft_consensus.cc:504] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.906901 11991 leader_election.cc:288] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
I20260925 04:54:58.907306 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f2344782424660876a7b5f4e4649bd" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:58.907306 10143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f2344782424660876a7b5f4e4649bd" candidate_uuid: "604491977af14bc2b62f45a594c13bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "270ea27d66a1425eae85f73563e04c00"
I20260925 04:54:58.907531 10282 raft_consensus.cc:3037] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.907531 10143 raft_consensus.cc:3037] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:58.910271 10282 raft_consensus.cc:2454] T 73f2344782424660876a7b5f4e4649bd P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:58.910271 10143 raft_consensus.cc:2454] T 73f2344782424660876a7b5f4e4649bd P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 604491977af14bc2b62f45a594c13bf9 in term 1.
I20260925 04:54:58.910691 10353 leader_election.cc:302] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, 604491977af14bc2b62f45a594c13bf9, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:58.911029 11991 raft_consensus.cc:2781] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:58.911185 11991 raft_consensus.cc:686] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 604491977af14bc2b62f45a594c13bf9, State: Running, Role: LEADER
I20260925 04:54:58.911446 11991 consensus_queue.cc:237] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:58.970290 11985 catalog_manager.cc:1259] Loaded cluster ID: 7112e019467c45efb2b1b4dc157b9eaf
I20260925 04:54:58.970400 11985 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: loading cluster ID for follower catalog manager: success
I20260925 04:54:58.974089 11985 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: acquiring CA information for follower catalog manager: success
I20260925 04:54:58.976938 11985 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 04:54:59.012770 12056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:59.013048 12056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:59.014683 12056 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:59.015900 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:59.017258 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:54:59.017609 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:54:59.017766 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:59.018097 12056 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:54:59.199275 12060 raft_consensus.cc:482] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:54:59.199532 12060 raft_consensus.cc:504] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:59.200470 12060 leader_election.cc:288] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:59.201030 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" is_pre_election: true
I20260925 04:54:59.201143 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9" is_pre_election: true
I20260925 04:54:59.201292 10282 raft_consensus.cc:2454] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:59.201453 10416 raft_consensus.cc:2454] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 0.
I20260925 04:54:59.201748 10077 leader_election.cc:302] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:59.202081 12060 raft_consensus.cc:2781] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 04:54:59.202169 12060 raft_consensus.cc:482] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 04:54:59.202272 12060 raft_consensus.cc:3037] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:59.204258 12060 raft_consensus.cc:504] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:59.204824 12060 leader_election.cc:288] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Requested vote from peers d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869), 604491977af14bc2b62f45a594c13bf9 (127.9.81.131:37105)
I20260925 04:54:59.205256 10282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4"
I20260925 04:54:59.205389 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57deb2c5e31d410e82ad12948dbc0da3" candidate_uuid: "270ea27d66a1425eae85f73563e04c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "604491977af14bc2b62f45a594c13bf9"
I20260925 04:54:59.205462 10282 raft_consensus.cc:3037] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:59.205587 10416 raft_consensus.cc:3037] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 04:54:59.207458 10282 raft_consensus.cc:2454] T 57deb2c5e31d410e82ad12948dbc0da3 P d3c81f5b22cd4de9b25c02fd05b536b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:59.207863 10077 leader_election.cc:302] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4; no voters:
I20260925 04:54:59.208122 12060 raft_consensus.cc:2781] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 04:54:59.208285 10416 raft_consensus.cc:2454] T 57deb2c5e31d410e82ad12948dbc0da3 P 604491977af14bc2b62f45a594c13bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 270ea27d66a1425eae85f73563e04c00 in term 1.
I20260925 04:54:59.208561 12060 raft_consensus.cc:686] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [term 1 LEADER]: Becoming Leader. State: Replica: 270ea27d66a1425eae85f73563e04c00, State: Running, Role: LEADER
I20260925 04:54:59.209388 12060 consensus_queue.cc:237] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } }
I20260925 04:54:59.525842 11991 consensus_queue.cc:1035] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:59.533418 11991 consensus_queue.cc:1035] T d56b51c4a06f4f2c9d54e1dce1afb9ea P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:59.667248 11600 consensus_queue.cc:1035] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:59.673532 11600 consensus_queue.cc:1035] T 8550736cdc014441a3219ea1e3391145 P d3c81f5b22cd4de9b25c02fd05b536b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:59.722615 12078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:54:59.722806 12078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:54:59.723374 12078 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:54:59.725397 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:54:59.725574 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:54:59.725792 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:54:59.726140 12078 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:54:59.987848 12070 consensus_queue.cc:1035] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:54:59.994553 12070 consensus_queue.cc:1035] T 73f2344782424660876a7b5f4e4649bd P 604491977af14bc2b62f45a594c13bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:55:00.132586 12060 consensus_queue.cc:1035] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:55:00.138711 12086 consensus_queue.cc:1035] T 57deb2c5e31d410e82ad12948dbc0da3 P 270ea27d66a1425eae85f73563e04c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 04:55:00.240646 9542 master-stress-test.cc:578] Killing test thread 1/25
I20260925 04:55:00.612223 12091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:00.612377 12091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:00.613062 12091 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:00.614789 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:00.614985 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:00.615159 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:00.615403 12091 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:01.618088 12109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:01.618294 12109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:01.618996 12109 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:01.620913 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:01.621212 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:01.621361 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:01.621575 12109 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:02.923373 12128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:02.923595 12128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:02.924199 12128 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:02.926195 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:02.926354 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:02.926522 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:02.926761 12128 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:02.992453 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:02.992602 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:03.919778 12146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:03.919999 12146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:03.920642 12146 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:03.925199 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:03.925473 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:03.925588 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:03.925812 12146 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:04.619319 12089 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:55:04.619525 12089 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:55:04.620476 12089 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:55:04.621279 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:55:04.621454 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:55:04.621627 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:55:04.621907 12089 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:55:06.040469 12178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:06.040702 12178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:06.041468 12178 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:06.042771 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260925 04:55:06.044108 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:06.044370 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:55:06.044502 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:06.044706 12178 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:07.999655 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:07.999819 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:13.002424 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:13.002630 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:13.685227 12199 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:55:13.685483 12199 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:55:13.686228 12199 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:55:13.687028 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:55:13.687259 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:55:13.687350 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:55:13.687630 12199 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:55:14.583760 12294 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:14.583992 12294 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:14.584710 12294 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:14.585867 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:55:14.587234 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:14.587500 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:14.587651 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:14.587939 12294 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:15.594395 12311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:15.594609 12311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:15.595362 12311 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:15.597312 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:15.597580 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:15.597690 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:15.597894 12311 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:18.005756 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:18.005968 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:21.680341 12400 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:21.680569 12400 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:21.681181 12400 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:21.682231 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:55:21.683494 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:21.683661 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:55:21.683815 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:21.684007 12400 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:22.482617 12413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:22.482834 12413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:22.483426 12413 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:22.485460 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:22.485647 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:22.485831 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:22.486070 12413 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:23.008404 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:23.008543 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:28.010645 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:28.010792 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260925 04:55:30.012292 10327 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (91 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:30.154938 10464 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (69 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:30.240886 10189 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (92 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:31.715812 12408 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:55:31.716001 12408 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:55:31.716897 12408 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:55:31.717872 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:55:31.718075 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:55:31.718166 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:55:31.718376 12408 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:55:33.013494 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:33.013648 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:35.228278 12595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:35.228503 12595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:35.229367 12595 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:35.230581 11918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:55:35.232218 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:35.232430 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:55:35.232547 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:35.232777 12595 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:38.016750 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:38.016903 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:43.019826 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:43.020042 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:45.959561 12744 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:55:45.959817 12744 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:55:45.960481 12744 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:55:45.961215 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:55:45.961372 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:55:45.961463 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:55:45.961679 12744 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:55:47.538080 12766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:47.538319 12766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:47.538983 12766 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:47.539983 11918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:55:47.541198 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:47.541440 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:47.541527 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:47.541755 12766 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:48.022130 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:48.022281 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:50.352015 12810 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:50.352193 12810 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:50.352782 12810 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:50.354718 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:55:50.354903 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:55:50.355031 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:50.355293 12810 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:53.025133 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:53.025338 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:55.044649 12876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:55.044857 12876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:55.045692 12876 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:55.046613 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:55:55.047685 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:55.047844 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:55:55.048003 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:55.048282 12876 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:55:58.027760 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:55:58.027908 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:55:58.491487 12929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:55:58.492102 12929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:55:58.492843 12929 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:55:58.494763 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:55:58.494911 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:55:58.495050 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:55:58.495308 12929 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:56:00.091423 12951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:00.091615 12951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:00.092278 12951 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:00.093243 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:56:00.096704 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:56:00.096942 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:56:00.097077 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:00.097355 12951 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:56:01.130483 12833 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:01.130717 12833 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:01.131628 12833 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:01.132529 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:01.132742 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:01.132874 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:01.133178 12833 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:03.030578 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:03.030735 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:07.808947 12833 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:07.809213 12833 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:07.809844 12833 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:07.810675 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:07.810827 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:07.810986 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:07.811215 12833 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:08.033669 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:08.034255 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:13.037654 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:13.037847 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:17.395076 13184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:17.395267 13184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:17.396009 13184 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:17.397511 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:56:17.398834 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:56:17.399206 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:56:17.399394 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:17.399683 13184 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:56:18.040551 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:18.040709 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:23.043335 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:23.043495 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:23.104168 13241 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:23.104414 13241 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:23.105275 13241 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:23.106149 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:23.106305 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:23.106478 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:23.106717 13241 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:28.046247 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:28.046391 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:28.398831 13338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:28.399123 13338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:28.399878 13338 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:28.400530 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:56:28.401899 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:56:28.402115 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:56:28.402273 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:28.402534 13338 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 04:56:30.191433 10327 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (211 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:56:30.350112 10462 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (212 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:56:30.442343 10191 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (191 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:56:31.975072 13241 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:31.975272 13241 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:31.975812 13241 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:31.976696 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:31.976869 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:31.977030 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:31.977267 13241 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:33.049201 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:33.049346 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:37.806183 13460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:37.806386 13460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:37.807066 13460 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:37.807984 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:56:37.809283 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:56:37.809521 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:56:37.809650 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:37.809866 13460 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:56:38.051616 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:38.051761 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:42.481555 13510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:42.481727 13510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:42.482462 13510 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:42.484324 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:56:42.484530 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:56:42.484655 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:42.484920 13510 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:56:43.054486 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:43.054646 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:43.119625 13464 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:43.119791 13464 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:43.120638 13464 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:43.121424 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:43.121613 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:43.121776 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:43.122009 13464 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:48.057346 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:48.057536 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:53.060384 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:53.060566 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:53.805743 13464 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:56:53.805955 13464 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:56:53.806653 13464 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:56:53.807739 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:56:53.808398 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:56:53.808545 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:56:53.808795 13643 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:56:58.063292 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:56:58.063457 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:56:58.205996 11920 maintenance_manager.cc:419] P 37499e1d150b41169507d4dd098579b5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033402
I20260925 04:56:58.259028 11919 maintenance_manager.cc:643] P 37499e1d150b41169507d4dd098579b5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.052s user 0.028s sys 0.000s Metrics: {"bytes_written":33387,"cfile_init":1,"dirs.queue_time_us":422,"dirs.run_cpu_time_us":212,"dirs.run_wall_time_us":1181,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":666,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":81,"thread_start_us":478,"threads_started":2,"wal-append.queue_time_us":291}
I20260925 04:56:58.260193 11920 maintenance_manager.cc:419] P 37499e1d150b41169507d4dd098579b5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4371 bytes on disk
I20260925 04:56:58.260842 11919 maintenance_manager.cc:643] P 37499e1d150b41169507d4dd098579b5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260925 04:56:59.450407 13723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:56:59.450685 13723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:56:59.451653 13723 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:56:59.452708 11918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:56:59.453927 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:56:59.454111 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:56:59.454290 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:56:59.454561 13723 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:03.065972 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:03.066125 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:08.068598 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:08.068751 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:11.896550 13904 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:11.896778 13904 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:11.897614 13904 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:11.898506 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:11.898674 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:11.898772 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:11.898969 13904 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:13.071611 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:13.071798 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:16.146935 13904 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:16.147083 13904 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:16.147575 13904 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:16.148240 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:16.148408 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:16.148520 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:16.148763 13904 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:17.752899 13993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:17.753129 13993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:17.754000 13993 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:17.755035 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:57:17.756234 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:57:17.756430 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:57:17.756561 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:17.757249 13993 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:18.074250 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:18.074456 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:23.077387 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:23.077579 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:24.455708 14022 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:24.455889 14022 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:24.456477 14022 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:24.457444 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:24.457643 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:24.457803 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:24.458071 14022 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:28.080284 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:28.080440 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:29.122854 14145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:29.123027 14145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:29.123589 14145 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:29.124712 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:57:29.125891 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:57:29.126087 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:57:29.126190 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:29.126380 14145 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 04:57:30.378163 10327 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (331 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:57:30.530184 10464 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (309 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:57:30.615367 10189 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (332 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:57:33.084401 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:33.084615 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:37.966547 14290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:37.966775 14290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:37.967505 14290 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:37.968516 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:57:37.969827 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:57:37.970022 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:57:37.970192 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:37.970450 14290 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:38.086845 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:38.087050 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:38.767310 14270 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:38.767477 14270 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:38.768277 14270 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:38.769263 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:38.769418 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:38.769562 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:38.769804 14270 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:42.319971 14270 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:42.320112 14270 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:42.320603 14270 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:42.321465 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:42.321587 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:42.321672 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:42.321873 14270 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:43.089843 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:43.090003 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:44.359005 14402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:44.359290 14402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:44.360072 14402 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:44.361097 11918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:57:44.362094 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:57:44.362267 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:57:44.362424 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:44.362682 14402 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:47.191866 14455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:47.192081 14455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:47.192857 14455 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:47.195538 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:57:47.195772 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:57:47.195916 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:47.196203 14455 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:48.092432 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:48.092585 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:48.816485 14487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:48.816712 14487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:48.817485 14487 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:48.819536 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:57:48.819710 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:57:48.819813 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:48.820029 14487 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:49.161820 14389 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:57:49.162015 14389 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:57:49.162700 14389 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:57:49.163723 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:57:49.163892 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:57:49.164000 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:57:49.164278 14389 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:57:51.952672 14542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:51.952909 14542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:51.953644 14542 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:51.954527 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260925 04:57:51.955788 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:57:51.955967 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:57:51.956125 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:51.956367 14542 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:53.095153 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:53.095346 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:57:57.722323 14645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:57:57.722602 14645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:57:57.723284 14645 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:57:57.724303 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:57:57.725481 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:57:57.725662 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:57:57.725801 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:57:57.726033 14645 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:57:58.097847 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:57:58.098022 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:02.915661 14586 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:02.915855 14586 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:02.916659 14586 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:02.917721 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:02.917842 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:02.917915 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:02.918135 14586 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:03.101128 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:03.101341 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:05.136256 14771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:58:05.136497 14771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:58:05.137339 14771 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:58:05.138193 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:58:05.139794 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:58:05.139987 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:58:05.140112 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:58:05.140312 14771 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:58:08.104290 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:08.104462 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:09.836074 14847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:58:09.836338 14847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:58:09.837034 14847 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:58:09.839560 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:58:09.839748 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:58:09.839928 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:58:09.840219 14847 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:58:11.522286 14768 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:11.522435 14768 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:11.523074 14768 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:11.523835 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:11.523998 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:11.524101 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:11.524353 14768 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:13.107101 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:13.107281 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:18.110320 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:18.110530 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:19.025647 15001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:58:19.025887 15001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:58:19.026551 15001 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:58:19.027577 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260925 04:58:19.028753 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:58:19.028923 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:58:19.029116 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:58:19.029392 15001 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:58:21.789361 14953 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:21.789529 14953 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:21.790287 14953 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:21.791035 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:21.791173 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:21.791289 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:21.791528 14953 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:23.113775 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:23.113960 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:27.166045 15138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:58:27.166303 15138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:58:27.166955 15138 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:58:27.169685 11918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:58:27.170950 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:58:27.171103 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:58:27.171269 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:58:27.171546 15138 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:58:28.116374 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:28.116515 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:30.392483 14953 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:30.392716 14953 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:30.393402 14953 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:30.394311 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:30.394488 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:30.394603 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:30.394899 14953 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 04:58:30.570261 10329 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (430 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:58:30.719192 10462 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (452 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:58:30.810735 10191 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (431 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:58:33.119282 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:33.119433 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:34.481222 15237 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:34.481374 15237 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:34.482115 15237 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:34.482973 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:34.483080 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:34.483223 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:34.483428 15237 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:38.122511 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:38.122691 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:40.755450 15366 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:58:40.755672 15366 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:58:40.756361 15366 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:58:40.757416 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:58:40.758828 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:58:40.759137 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:58:40.759294 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:58:40.759558 15366 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:58:42.904903 15237 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:42.905193 15237 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:42.905954 15237 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:42.906903 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:42.907021 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:42.907099 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:42.907279 15237 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:43.125223 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:43.125379 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:48.128552 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:48.128707 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:53.131333 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:53.131503 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:58:56.799168 15535 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:58:56.799494 15535 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:58:56.800148 15535 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:58:56.801196 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:58:56.801332 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:58:56.801466 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:58:56.801703 15535 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:58:58.134230 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:58:58.134384 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:00.711414 15682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:59:00.711645 15682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:59:00.712447 15682 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:59:00.713398 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:59:00.715271 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:59:00.715436 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:59:00.715575 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:59:00.715824 15682 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:59:01.695986 15694 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:01.696147 15694 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:01.696870 15694 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:01.697633 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:01.697746 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:01.697873 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:01.698105 15694 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:03.137566 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:03.137778 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:07.458391 15694 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:07.458591 15694 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:07.459223 15694 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:07.460237 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:07.460379 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:07.460508 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:07.460733 15694 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:08.140749 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:08.140903 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:12.578446 15694 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:12.578615 15694 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:12.579144 15694 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:12.580029 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:12.580173 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:12.580320 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:12.580535 15694 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:13.143833 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:13.143992 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:14.474745 15893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:59:14.474979 15893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:59:14.475731 15893 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:59:14.476625 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:59:14.478010 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:59:14.478176 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:59:14.478304 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:59:14.478554 15893 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:59:18.146739 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:18.146917 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:22.492964 15898 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:22.493168 15898 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:22.493925 15898 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:22.494648 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:22.494808 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:22.494917 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:22.495150 15898 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:22.787351 15996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:59:22.787582 15996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:59:22.788321 15996 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:59:22.789443 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:59:22.790694 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:59:22.790898 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:59:22.791086 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:59:22.791321 15996 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:59:23.148962 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:23.149192 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:26.673640 15898 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:26.673858 15898 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:26.674360 15898 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:26.675154 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:26.675311 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:26.675423 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:26.675644 15898 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:28.151999 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:28.152199 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260925 04:59:30.768702 10329 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (550 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:59:30.912497 10464 heartbeater.cc:644] Failed to heartbeat to 127.9.81.189:45475 (549 consecutive failures): Network error: Failed to ping master at 127.9.81.189:45475: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
W20260925 04:59:31.006294 10189 heartbeater.cc:644] Failed to heartbeat to 127.9.81.188:40705 (572 consecutive failures): Network error: Failed to ping master at 127.9.81.188:40705: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
I20260925 04:59:31.077832 15898 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:31.077966 15898 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:31.078436 15898 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:31.079142 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:31.079300 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:31.079384 10351 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:31.079622 15898 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:33.154767 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:33.154912 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:38.158043 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:38.158253 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:39.685946 16257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9c78f840b646474a98deff6bac54d5cc)
I20260925 04:59:39.686219 16257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37499e1d150b41169507d4dd098579b5" member_type: VOTER last_known_addr { host: "127.9.81.190" port: 37617 } } peers { permanent_uuid: "9c78f840b646474a98deff6bac54d5cc" member_type: VOTER last_known_addr { host: "127.9.81.189" port: 45475 } } peers { permanent_uuid: "39da3a5fade344af9db436d10052b4bc" member_type: VOTER last_known_addr { host: "127.9.81.188" port: 40705 } }
I20260925 04:59:39.687055 16257 leader_election.cc:288] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475), 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705)
W20260925 04:59:39.688239 11917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260925 04:59:39.689728 11918 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39da3a5fade344af9db436d10052b4bc (127.9.81.188:40705): Network error: Client connection negotiation failed: client connection to 127.9.81.188:40705: connect: Connection refused (error 111)
W20260925 04:59:39.689916 11917 leader_election.cc:334] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9c78f840b646474a98deff6bac54d5cc (127.9.81.189:45475): Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111)
I20260925 04:59:39.690021 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37499e1d150b41169507d4dd098579b5; no voters: 39da3a5fade344af9db436d10052b4bc, 9c78f840b646474a98deff6bac54d5cc
I20260925 04:59:39.690220 16257 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37499e1d150b41169507d4dd098579b5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 04:59:43.160919 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:43.161176 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:44.956849 16224 raft_consensus.cc:482] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 04:59:44.957058 16224 raft_consensus.cc:504] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "270ea27d66a1425eae85f73563e04c00" member_type: VOTER last_known_addr { host: "127.9.81.129" port: 36933 } } peers { permanent_uuid: "604491977af14bc2b62f45a594c13bf9" member_type: VOTER last_known_addr { host: "127.9.81.131" port: 37105 } } peers { permanent_uuid: "d3c81f5b22cd4de9b25c02fd05b536b4" member_type: VOTER last_known_addr { host: "127.9.81.130" port: 33869 } }
I20260925 04:59:44.958118 16224 leader_election.cc:288] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933), d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869)
W20260925 04:59:44.958877 10351 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3c81f5b22cd4de9b25c02fd05b536b4 (127.9.81.130:33869): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
W20260925 04:59:44.959054 10353 leader_election.cc:341] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 270ea27d66a1425eae85f73563e04c00 (127.9.81.129:36933): Not found: Tablet not found: e7ceefe8a6894cc78cf3d7d5f3433c8e
I20260925 04:59:44.959185 10353 leader_election.cc:302] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 604491977af14bc2b62f45a594c13bf9; no voters: 270ea27d66a1425eae85f73563e04c00, d3c81f5b22cd4de9b25c02fd05b536b4
I20260925 04:59:44.959399 16224 raft_consensus.cc:2726] T e7ceefe8a6894cc78cf3d7d5f3433c8e P 604491977af14bc2b62f45a594c13bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 04:59:48.164202 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:48.164415 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:53.167161 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:53.167296 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:58.169905 11898 master_runner.cc:186] Error getting master registration for 127.9.81.189:45475: Network error: Client connection negotiation failed: client connection to 127.9.81.189:45475: connect: Connection refused (error 111),
I20260925 04:59:58.170047 11898 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260925 04:59:58.514559 11920 maintenance_manager.cc:419] P 37499e1d150b41169507d4dd098579b5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4371 bytes on disk
I20260925 04:59:58.519677 11919 maintenance_manager.cc:643] P 37499e1d150b41169507d4dd098579b5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.005s sys 0.000s Metrics: {"dirs.queue_time_us":398,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":105,"thread_start_us":465,"threads_started":2,"wal-append.queue_time_us":310}
W20260925 04:59:59.011960 10471 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
W20260925 04:59:59.012272 10471 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
W20260925 04:59:59.012408 10471 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
W20260925 04:59:59.012530 10471 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
F20260925 04:59:59.023204 10500 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Aborted at 1790312399 (unix time) try "date -d @1790312399" if you are using GNU date ***
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800002546) received by PID 9542 (TID 0x7f88b8add700) from PID 9542; stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
@ 0x7f88ca0baa46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031528 10497 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031528 10497 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031695 10483 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1d5987cf0ad94f428a8c5ad200753709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031528 10497 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031695 10483 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1d5987cf0ad94f428a8c5ad200753709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031962 10494 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, *** Check failure stack trace: ***
@ 0x7f88ce1fc980 (unknown) at ??:0
num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031528 10497 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031695 10483 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1d5987cf0ad94f428a8c5ad200753709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031962 10494 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.033128 10498 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F*** Check failure stack trace: ***
F20260925 04:59:59.023391 10484 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7f50ccca03c042aeb74dd26f1ca15658 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023475 10495 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023629 10493 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.023633 10487 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024859 10480 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b32729c82a4b4c558c9a830e172a0c3b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.024896 10490 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.026141 10481 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4a0c924d2d034690b79dd3b5cba5b781 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027397 10486 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_374e8adb8ba2493996c57ce359e519b7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.027487 10478 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93ed1c5bfdde46bfa22c83e91ab4a5ed on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:
:59.027489 10479 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_273e0dfb03e648e4b9fd3a8abf07a709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028559 10499 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.028782 10482 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80d05ca86f934088be48a6989b971ac4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029881 10492 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.029927 10491 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031104 10496 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031251 10485 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260925 04:59:59.031281 10477 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_41a0c852a29745399a4b27608bae6f60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)Timed out: Error creating table default.Table_9a7f064f807444c69ef2ae958de42e7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031528 10497 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031695 10483 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1d5987cf0ad94f428a8c5ad200753709 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.031962 10494 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.033128 10498 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)F20260925 04:59:59.033185 10503 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.9.81.190:37617,127.9.81.189:45475,127.9.81.188:40705, num_attempts: 1)
*** Check failure stack trace: ***
@ 0x7f88c73e8e87 gsignal at ??:0
@ 0x7f88c73ea7f1 abort at ??:0
@ 0x7f88ca0ac9ad google::LogMessage::Fail() at ??:0
@ 0x7f88ca0af88a google::LogMessage::SendToLog() at ??:0
@ 0x7f88ca0ac4de google::LogMessage::Flush() at ??:0
@ 0x7f88ca0ada19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x403d42 kudu::MasterStressTest::CreateTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:298
@ 0x444b44 std::__invoke_impl<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:73
@ 0x4449fd std::__invoke<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:95
@ 0x4449ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:244
@ 0x44496e std::thread::_Invoker<>::operator()() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:253
@ 0x4446a9 std::thread::_State_impl<>::_M_run() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:196
@ 0x7f88d2b38a4f execute_native_thread_routine at ??:0
@ 0x7f88ce1f16db start_thread at ??:0
@ 0x7f88c74cb61f clone at ??:0